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Abstract 



A set of behavior anchored scales (BAS) to measure eleven factors 
related to the technical job performance and techn^ ^1 updating 
activities of engineers was developed* A total of 3^:; ^r:;?. neers and 
technical supervisors from 94 organizations particip.<5i.< various 
phases of the project. Separate groups of engineers . v. rvisors 
developed the factors relevant to performance and updatinc] , f ^ nerated 
behavioral examples of the factors, classified the behavioral examples 
according to the factors, scaled the favorability of the behavioral 
examples, and evaluated engineers using the final sc'^i^^s. Data 
collected in the last phase of the project suggested that the final set 
of scales could be used to describe the technical performance and 
updating activities of engineers. The factor scales: (a) were 
moderately intercorrelated, suggesting a minimum of halo error; (b) 
demonstrated sufficiently large standard deviations of ratings, 
suggesting that raters were differentiating among ratees; and (c) had 
mean ratings above the middle point of the scale which probably 
approximated the objective performance level of the ratees, although 
leniency error cannot be ruled out as possibly existing. 

The set of BAS instruments appears to be useful in detecting 
possible technical job performance deficiencies that may suggest 
technical updating needs of the engineer. They may also be used to 
provide feedback to the engineer regarding performance arid his or her 
current attempts at updating. They can also serve as input to the 
design of professional and career development plans for the engineer. 
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The scales are not intended to specify the exact kind of updating 
required by a particular engineer as they are designed to be useful to a 
wide variety of engineering disciplines and organizations. The major 
use of the scales would be to measure the general need for technical 
updating among engineers. 
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Behavior Anchored Scales - A Method for Identifying 
Continuing Education Needs of Engineers 



Technical obsolescence among engineers has been identified as a 
critical problem facing American industry (Dubin, Shelton, and 
McCormick, 1973; Kaufman, 1974; National Science Foundation, 1976; 
Raudsepp, 1976; Ritti, 1971). Technical obsolescence refers to the lack 
of current technical knowledge and skills that are necessary for 
effective performance of job assignments. Much ^.ttention has been 
directed toward the reduction, and hopefully the prevention, of 
technical obsolescence among engineers. One approach to the reduction 
and prevention of obsolescence has been to focus upon technical updating 
activities in which engineers might engage. Technical updating 
activities refer to the various ways in which an engineer might learn 
about current technical developments and applications. 

Although the need for an engineer to engage in technical updating 
throughout his or her technical career has been widely recognized (e.g., 
Dubin, et al. , 1973; Kaufman, 1974; National Science Foundation, 1976), 
there has not existed an adequate method of determining who needs what 
kind of updating. Most investigations of technical updating and 
obsolescence have relied upon some form of self -assessment (e.g., Dubin 
and Marlow, 1965; Dubin and Regan, 1977; Ritti, 1971). Engineers have 
been asked what they perceive to be their own deficiencies in technical 
knowledge and skills. While this approach can produce valuable 
information, it is difficult to make direct comparisons between various 
engineers due to the subjective and somewhat unstructured nature of the 
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data obtained. The accuracy of such deficiency estimates may be 
questioned also since it seems reasonable to assume that these estimates 
may typically be biased in the direction of reporting leso deficiency 
than may actually exist* 

Another approach to determining the technical updating needs of 
engineers is to seek information from the supervisors of engineers. 
Supervisory personnel are typically in a position to evaluate the work 
output of their subordinate engineers, to compare the technical work of 
various engineers, and to be knowledgeable concerning the technical 
needs of the organization. However, several studies (e.g., Dubin and 
Marlow, 1965; Landis, 1969; National Science Foundation, 1969) have 
reported that supervisors often do not take much interest in the 
continuing education and professional development of their subordinate 
engineers. Likewise, it has also been reported that supervisory 
personnel often do not give their subordinate engineers detailed 
performance feedback concerning their technical job duties. A possible 
reason for both the lack of interest in the continued professional 
development of subordinates and the lack of performance feedback to 
subordinates is the absence of a systematic method of identifying 
technical performance strengths and weaknesses. 

It would be desirable, then, to have a method which would satisfy 
several needs. A technique is needed which would help to identify the 
technical updating needs of engineers that would allow comparison both 
within and between individual engineers, preferably which could be used 
by supervisory personnel to evaluate their subordinate engineers end by 
engineers for self evaluation. The technique should also aid 




8 



3 



supervisors In providing feedback to their subordinate engineers about 
their technical job performance and In establishing professional 
development programs for their subordinates. The method should be as 
objective as possible while recognizing the Inherent subjectivity of 
such judgments and recognizing the variability Inherent In job 
assignments, technical requirements, and developmental needs of various 
engineers and organizations. 

An approach which appears to offer promise In the achievement of 
the objectives described above Is the behavior anchored scale (BAS) 
method of developing rating scales. The BAS method and underlying 
assumptions are d:«scussed In the next section. This discussion Is 
followed by a conslderatloii of the application of the BAS method to 
technical updating concerns. 

Behavior Anchored Scales 
In 1963, Smith and Kendall Introduced a new method of rating scale 
development and utilization called behavioral expectation scaling. This 
scale format also ber:ame known as the behavior anchored scale method 
(BAS). The BAS rating scale format differs from other scale formats, 
namely the graphic rating scale, primarily in three respects: 1) Smith 
aind Kendall philosophically differ from other psychologists in their 
approach to scale construction; 2) the philosophical difference is 
reflected in the difference between the procedure for BAS construction 
and the procedure for the construction of traditional formats; and 3) 
physically, the BAS format differs from the more traditional graphic 
rating scales. Each difference will be briefly discussed below. 
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First, Smith and Kendall state that psychologists tend to impose 
their own beliefs and interpretations about behavior and job performance 
upon raters. Many psychologists believe that this is necessary in order 
to obtain reliable and valid rating systems. For example, psychologists 
who favor trait theory construct scales which they believe reflect 
independent factors and those who believe performance is a composite of 
observed behaviors devise items reflecting good and poor performance 
(Smith & Kendall, 1963). The construction of these scales is primarily 
based on the psychologist's own values and beliefs. The raters who will 
be using the traditional rating scale are rarely consulted as to their 
interpretation of the dimensions and rarely participate in the 
construction of the scales. Constructing traditional scales based on 
the psychologists' values assumes: 1) that psychologists understand and 
agree upon the organization of the traits or dimensions relevant to the 
job in question, and 2) that raters agree with the psychologists on the 
interpretation of the traits. Without the participation and consensus 
of the raters in the scale construction process. Smith and Kendall state 
that agreement on the interpretation of the scale dimensions cannot t-: 
achieved. The BAS differs philosophically from the development of other 
scale formats in that the contribution of the raters and the ratees who 
will be subsequently using the form and evaluated by the form is 
believed to be an essential input in the construction process. 

Second, the philosophic difference in the BAS approach is reflected 
in the differences between the procedures used in developing a 
traditional scale and the procedures used in BAS scale construction. In 
the traditional scale construction process, psychologists themselves 
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generally develop the dimensions and items of the scale. However, the 
BAS procedure involves a four-step process in which at each step 
independent groups of raters and ratees participate in the construction 
of the scale. Each of the four steps involved in the construction of 
the behavioral anchored rating scale is discussed in a later section. 

The third way in which the BAS differs from the traditional graphic 
rating scale is in physical appearance. Smith and Kendall (1963) 
describe the BAS format as a series of continuous graphic rating scales 
arranged vertically. Each scale which describes a specific dimension of 
performance is arranged with a label and dimension definition at the 
top. The anchors which appear at different intervals on the scale are 
examples of actual behaviors rather than adjectives or trait labels 
which are usually characteristic of traditional scales. The behavioral 
examples are intended to define a level (high, average or low 
performance) of a specific performance dimension. 
Proposed Advantages of the BAS 

The BAS has many proposed advantages (Smith and Kendall, 1963; 
Beatty, Schneier, and Beatty, 1977; Blood, 1974; Jacobs, Kafry and 
Zedeck, 1979) which can be categorized into three areas: 1) advantages 
for the organization; 2) advantages for the rater; and 3) advantages for 
the ratee. Each one of these areas is briefly discussed below. 
Organizational benefits . Blood (1974) and Jacobs, et al. (1979) have 
suggested that the BAS procedure provides for an analysis within and 
between organizational levels on the agreement of policy. Blood (1974) 
states that item variances, obtained during the phase in which each item 
is scaled according to the level of performance it reflects, indicate 
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the agreement among managers or raters on the appropriateness of certain 
behaviors. Large variances indicate low agreement among managers about 
specific behaviors. In order to maximize the accuracy of a rating 
scale, agreement among the raters regarding which behaviors reflect 
appropriate and inappropriate behaviors is essential. It has been 
proposed that the BAS procedures allow for this type of analysis. 

Blood (1974) has also suggested that the BAS procedure may be 
useful in assessing the accuracy of the communication of organizational 
policy between organizational levels. In the BAS procedure, items 
(reflecting specific performance dimensions) are scaled on the degree to 
which they reflect effective or ineffective performance. The scale 
value of an item is its mean rating. Mean item values can be collected 
from different organizational levels to determine how well 
organizational policy has been communicated among the levels. Poor 
communication may be indicated where mean item values vary subi^tantially 
between organizational levels. 

Another proposed organizational advantage in using the BAS 
procedure is that the behavioral items collected could provide a basis 
for training (Jacobs, et al., 1979). For example, if a task is not 
being performed effectively across departments, the organization can 
develop a training program to correct the noted deficiencies (Jacobs, et 
al., 1979) 

Advantages to the Rater ( Supervisor ). By evaluating individuals on 
specific performance dimensions and ordering the dimensions in terms of 
performance proficiency for a given individual, the supervisor has the 
necessary information to focus his/her attention where improvement in 
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the subordinate's performance is most needed (Jacobs, et al., 1979). 
The supervisor may also be able to identify training needs of 
individuals if, for example, many are rated low on a specific 
performance dimension. Thus, the supervisor can use the BAS in 
performing one of the most improtant supervisory duties, guidance and 
development of the employees* 

Advantages to Ratees • The BAS method has the potential to identify 
strengths and weaknesses for each ratee because it is a multi-factor 
evaluation method* However, unlike many evaluation methods, the BAS 
provides a behavioral component which enables the ratee to compare his 
or her level of actual performance against actual -^ob tasks (Jacobs, et 
al., 1979). This behavioral component is the explicit statement of 
effective and ineffective job behaviors* These behaviors can serve as 
performance goals for the employee. Feedback to the employee, when 
positive, may serve as a source of satisfaction or motivation. On the 
other hand, feedback indicating employee weaknesses may indicate certain 
areas where the employee needs training or additional education. The 
BAS procedure could be expected to lead to improved employee performance 
because of ratee participation in the development of the scale and 
because performance expectations are behaviorally specified. 
Improvement in employee performance could also be expected by 
implementing the scales as a feedback vehicle to specific employee 
behavioral deficiencies. 
Limitations of BAS 

Many researchers in this area agree that BAS are expensive to 
construct. The accepted procedure to develop this scale requires 
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Independent judges (raters, ratees or both) to develop the dimensions 
and dimension definitions, to develop behavioral examples of these 
dimensions, and to assign scale values to these behavioral examples. 
The effectiveness of the scale depends, in part, on the independence of 
the groups in each of the developmental stages (Landy & Farr, 1980). 
Thus, the investment of time is extensive in the development of BAS. 
Since the time and expense involved in constructing this scale is 
considerable, one would expect that behavior anchored scaled would have 
some advantage (more error-free) over other methods. There have been 
several extensive reviews of the advantages of the behavior anchored 
scale (Schwab, Heneman, & DeCotiis, 1975; Bemardin, et al., 1976; 
Bemardin, 1977; Landy & Farr, 1980) that indicate that they are not 
much better psychometrically than carefully constructed graphic scales 
or summated checklists (Landy & Trumbo, 1980). The procedures for 
developing a behavior anchored scale almost guarantee that the scales 
will be carefully developed. However, this is not necessarily the case 
with other formats. The multi-step process of developing a behavior 
anchored scale insures some quality in the final result (Landy & Trumbo, 
1980). A more detailed description of the BAS developmental procedures 
appears in the next section. 



The development of the behavior anchored scale requires that the 
participants in each of the construction phases have work experience 
similar to those who are later to use the scales. The language of the 
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scale should reflect the "jargon" or language of the job. It Is hoped 
that these goals are met by using the following four steps (Jacobs, et 
al.. 1979). 

Phase j[ • Dimension Generation and Example Development 

A group of raters meet to identify and define an exhaustive list of 
job dimensions or factors which are necessary for successful 
performance. Participants are encouraged to discuss the generated list 
of dimensions in order to eliminate redundancies and to combine 
overlapping terms. The result of this phase is usually a list of labels 
depicting factors relating to general areas of job performance. 

A second group of individuals is asked to take the dimensions 
generated earlier and provide behavioral examples of high, average and 
low performance on each of those dimensions. 
Phase II . Behavioral Example Allocation 

A third group of raters is given a list of the dimensions (and 
their definitions) and a randomized list of the behavioral examples 
generated in Phase I. They are asked to assign each behavioral example 
or item to the category or dimension that it best represents (Jacobs, 
et al., 1979)* Examples consistently assigned to a dimensiori (usually 
using a criterion of 60-70 percent of respondents) are retained. If 
behavioral examples cannot be allocated to a dimension (do not meet the 
agreement criterion), they are considered ambiguous and are eliminated 
from further phases. 

Phase III . Assignment of Scale Values to Behavioral Examples 

A fourth group is provided with the dimensions and their 
corresponding items that met the criteria in Phase II. They are asked 
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to assign scale values to each behavioral example. Indicating the level 
of performance on the specific dimension that the particular example 
represents (Landy & Trumbo, 1980). The means and standard deviations 
are computed for each example. According to Landy and Trumbo (1980), 
examples are selected if they meet the following criteria: 1) the set 
of examples have mean values which provide anchors for the entire scale 
and 2) they have relatively small standard deviations. When an example 
has a large standard deviation, it suggests that the example is either 
ambiguous or that raters cannot agree on the performance level that the 
example represents. The behavioral examples meeting the criteria for 
Phases II and III are then used in the final behavior anchored scale. 
Phase IV . Use of the Scales 

After the BAS for each factor or disr-ansion of performance has been 
constructed, the set of rating scales is next used by supervisory 
personnel to evaluate the performance of . their subordinates. These 
ratings are examined with regard to psychometric properties such as the 
mean ratings, the standard deviations of the ratings, and the rating 
intercorrelations. Desirable psychometric characteristics of the BAS 
are a mean rating relatively near the midpoint of the scale; a 
reasonably large standard deviation of the ratings which indicates that 
the raters are differentiating among ratees; and relatively low rating 
inter correlation, indicating that the raters are differentiating the 
relative strengths and weaknesses within individual ratees. 
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Application of BAS Methodology to Technical Updating 
Most of the applications of BAS methodology have been in the area 
of job performance evaluation and appraisal • The use of Che BAS 
approach to rating scale development in the area of technical updating 
is a relatively straightforward adaptation of the general logic of BAS. 
First, it may be assumed that the technical job performance level of an 
engineer provides information about the degree of technical up-to- 
dateness of that engineer. The engineer who performs technical 
assignments well is, by definition, at least adequately current with 
technological developments relevant to work assignments. The engineer 
who does not perform technical assignments well may suffer from 
technological obsolescence, although other factors may also affect job 
performance (such as poor work motivation or situational constraints). 
Thus, one promising indicant of the need for technical updating is the 
proficiency an engineer demonstrates in current technical job 
assignments. BAS instruments which measure the supervisor's judgment 
about an engineer's technical job performance would serve as good 
diagnostic devices concerning the need for technical updating. 

Furthermore, the BAS methodology readily lends itself to the 
measurement of behaviors other than job performance. The measurement of 
various possible updating activities in xAich an engineer might engage 
should be readily possible using the BAS technique. Measurement of the 
types of updating activities engaged in by an engineer can provide a 
basis for -comparison between current behavior and ideal or desirable 
updating behavior. This comparison should aid supervisory personnel and 
their subordinate engineers in determining a professional development 
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plan which Is likely to enhance the technical proficiency of the 
engineer • 

General Sampling Strategy 
Initial Sampling Procedure 

In order to construct the behavior anchored scales. It was 
originally proposed that ten workshops be conducted. The ten workshops 
were to be divided Into four phases of data collection and verification. 
The participants desired at the workshops were to be technical managers 
or supervisors of practicing engineers, representing a number of small 
and medium manufacturing companies located In Pennsylvania, New York, 
New Jersey, Massachusetts, and Ohio. The manufacturing companies would 
be selected on a random sampling basis. Table 1 gives the desired 
workshop arrangement* 

For the purpose of this study, a technical manager or supervisor 
was defined as a person in charge of a minimum of five practicing 
engineers who deals with day-to-day company problems and who holds an 
engineering degree. In addition, a practicing engineer was defined as 
having completed a Bachelor ' of Science degree in engineering from an 
accredited college of engineering and having had five years' work 
experience. Finally, a small manufacturing company was defined as 
having up to 500 employees and a medium ' one as having 500 - 5000 
employees. 

Seven locations were selected for the ten workshops in such a way 
that each of the five states were represented at least once, and each 
location had an adequate population of private manufacturing companies 
from which to draw a sample. For each location, a sample of 
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Table 1 

Proposed BAS Workshop Arrangement 



Phase Workshop No. Location No. of Managers No. of Companies 



I 


1 


A 




10 




12 




2 




4 




Dimension 


2 


B 




10 


- 


12 




2 


- 


4 




Identification 


3 


C 




10 




12 




2 




4 




II 


1 


D 




10 




12 




2 




4 




Allocation 


2 


E 




10 




12 




2 




4 




III 


1 


F 




10 




12 




2 




4 




Scaling 


2 


6 




10 




12 




2 




4 




IV 


1 


A - 


G* 


10 




12 


old 


2 




4 


old 


Application 








10 




12 


new 


2 




4 


old 




2 


A - 


G* 


10 




12 


old 


2 




4 


old 










10 




12 


new 


2 




4 


new 




3 


A - 


G* 


10 




12 


old 


2 




4 


old 










10 




12 


new 


2 




4 


new 



*Each of the workshops of Phase IV was to be held in a location already used in Phase I, 
II or III. New participants as well as past participants were to be included in these 
workshops. 
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approximately thirty companies was drawn, using various Industrial 
directories. (See Reference List) In addition, for three of the 
locations, a second sample of companies was drawn for Phase IV. The 
total sample drawn consisted of an equal mix of small and medium 
companies* For each company, an Individual was Identified who would be 
Interested In updating problems faced by engineers. These Individuals 
held such titles as chief engineer, plant engineer, general manager, 
manager of engineering, plant manager, vice-president of engineering, 
and president* 

A letter, which explained the purpose of the research and asked for 
their participation, was sent to each of the first twenty companies In 
the sample for each of the seven locations* In a second mailing, 
letters were sent to the remaining companies on each of the seven lists* 

Table 2 summarizes the results of the mailing. As can be seen from 
the table, 72*9 percent did not respond to the letter, and, of those who 
did respond , 62*5% (13*6% of the total mailed) replied "No*" Thus, out 
of 220 companies, 190 (86*3%) were unwilling to participate in the 
project* On a somewhat positive note, of the eighteen companies who 
replied "yes" or "maybe," twelve (66*7%) actually took part in a 
workshop* However, the number of companies willing to participate was 
not sufficient to conduct the seven workshops* Therefore, the original 
sampling procedure was modified in order to obtain a sufficient number 
of workshop participants* 

Modified Procedure for Obtaining Workshop Participants 

During the same time frame as this project, the project team was 
Involved with a related National Science Foundation project entitled 
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Table 2 
Results of BAS Nailing 



Phase- 


Desired 


Number Mailed 






Results 






Participated 
in 


Workshop 
Number 


Workshop 


First 


Second 


Not 


No 




Replied 




Location 


Mailing 


Mailing 


Delivered 


Reply 


No 


Maybe 


Yes 


Workshop 


• 

I-l 


Philadelphia 
Area 


20 


11 


4 

(12.9)* 


22 

(71.0) 


3 

(9.7) 


0 

( 0.0) 


2 

( 6.4) 


1 

(3.2) 


1-2 


New York City 
Area 


20 


10 


1 

(3.3) 


20 
(66.7) 


6 

(20.0) 


3 

(10.0) 


0 

(0.0) 


0 

(0.0) 


1-3 


Boston Area 


20 


13 


2 

( 6.1) 


24 
(72.7) 


6 

(18.2) 


1 

(3.0) 


0 

(0.0) 


0 

(0.0) 


II -1 


Cleveland Area 


20 


11 


1 

(3.2) 


22 

(71.0) 


6 

(19.4) 


0 

•( 0.0) 


2 

(6.4) 


2 

(6.4) 


TT - 9 


iiicsDurgn Area 


20' 


11 


( 9.7) 


20 
(64.5) 


3 

(9.7) 


3 

(9.7) 


2 

(6.4) 


4 

(12.9) 


III-l 


Newark, NJ Area 


20 


14 


1 

(2.9) , 


(76.5) 


4 

(11.8) 


(2.9) 


2 

(5.9) 


(8.8) 


III -2 


Harrisburg Area 


20 


10 


0 

( 0.0) 


26 

(86.7) 


2 

(6.7) 


1 

(3.3) 


1 

(3.3) 


2 

(6.7) 


TOTALS 




140 


80 


12 

(5.5) 


160 

(72.7) 


30 

(13.6) 


9 

(4.1) 


9 

(4.1) 


12 
(5.5) 



*nie numbers in parentheses are the percentages of total mailed. 
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"Relationships Among Individual Motivation, Work Motivation and Updating 
In Engineers" (Grant No. SED78-21941) •* 

In carrying out this research effort, workshops with engineers and 
engineering managers were also required. The primary difference in the 
workshops for the two projects was the size of the companies contacted 
for help. The behavior anchored scales (BAS) workshops were to be 
composed of engineers employed by small and medium companies, and the 
work motivation workshops composed of engineers employed by medium and 
large companies. There were also to be work motivation workshops 
composed of engineers and engineering managers working for governmental 
agencies . 

Thus, letters were sent for the work motivation workshops at about 
the same time as the BAS letters. The results of this mailing (see 
Table 3) were better than the BAS mailing. Of the 200 industries 
contacted, 23 (11.5Z) actually participated in a workshop, as compared 
to the BAS result. With the governmental agencies Included, the 

results were even better in that 57 out of 315 (18. 5Z) organizations 
participated. Even though the response for the work motivation 
workshops was better than the BAS, we did not have enough Industry 
participants to carry out the desired ten work motivation workshops. 

An obvious partial solution to the shortage of workshop 
participants for both projects was to combine workshops where possible. 
The major problem in doing this for the BAS project was that the 
industrial workshops would be primarily composed of medium and large 
companies and would not Include the desired number of smaller companies. 



*This project will be referred to as the work motivation project. 



Table 3 



Results of Work Motivation Project Mailing 



Desired 








Results 






Participated 


Workshop 


Number 


Not 


No 




Replied 




in 


Location 


Mailed 


Delivered 


Reply 


No 


Maybe 


Yes 


Workfihoo 


Industry Workshops 
















New York City 
Area 


20 


0 

( 0.0)* 


U 
(70.0) 


3 

(15.0) 


0 

(0.0) 


3 

(15.0) 


3 

(15.0) 


Bergen County, NJ 
Area 


20 


0 

(0.0) 


(70.0) 


3 

(15.0) 


0 

(0.0) 


3 

(15.0) 


2 

(10.0) 


Scran ton/Wilkes- 
Barre, PA Area 


20 


0 

(0.0) 


16 
(80.0) 


(20.0) 


0 , 

(0.0) 


0 

( 0.0) 


0 

( 0.0) 


Cleveland Area 


20 


2 

(10.0) 


12 
(60.0) 


2 

(10.0) 


1 

(5.0) 


3 

(15.0) 


2 

(10.0) 


Buffalo Area 


20 


2 

(10.0) 


17 
(85.0) 


1 

( 5.0) 


• 0 
(0.0) 


0 

( 0.0) 


0 

( 0.0) 


AUentown, PA 
Area 


20 


0 

(0.0) 


12 
(60.0) 


(20.0) 


1 

(5.0) 


3 

(15.0) 


3 

(15.0) 


Rochester, NY 
Area 


20 


0 

(0.0) 


13 
(65.0) 


5 

(25.0) 


0 

(0.0) 


2 

(10.0) 


2 

(10.0) 


Erie, PA 
Area 


20 


0 

(0.0) 


8 

(40.0) 


(20.0) 


4 

(20.0) 


(20.0) 


8 

(40.0) 


Trenton, NJ 
Area 


20 


1 

(5.0) 


17 
(85.0) 


2 

(10.0) 


0 

(0.0) 


0 

( 0.0) 


0 

( 0.0) 


Lewisburg/Williais- 
port, PA Area 


20 


0 

(0.0) 


12 
(60.0) 


3 

(15.0) 


0 

(0.0) 


5 

(25.0) 


3 

(15.0) 


Industry Subtotals 


200 


5 

(2.5) 


135 
(67.5) 


31 
(15.5) 


6 

( 3.0) 


23 

(11.5) 


23 
(11.5) 



Table 3 (cont'd) 



Results of Work Motivation Project Mailing 



Desired 








Results 






Participated 


Workshop 


Number 


Not 


No 




Replied 




in 


Location 


Mailed 


Delivered 


Reply 


No 


Maybe 


Yes 


Workshop 


Government Workshops 
















Philadelphia 
Area 


19 


0 

(0.0) 


7 

(36.8) 


2 

(10.5) 


4 

(21.1) 


6 

(31.6) 


9 

(47.4) 


Harrlsburg 
Area 


36 


0 

(0.0) 


10 
(27.8) 


12 
(33.3) 


4 

(11.1) 


10 
(27.8) 


10 
(27.8) 


Pittsburgh 
Area 


14 


0 

(0.0) 


6 

(42.9) 


3 

(21.4) 


0 

(0.0) 


5 

(35.7) 


4 

(28.6) 


Washington, DC 
Area 


20 


0 

(0.0) 


4 

(20.0) 


8 

(40.0) 


4 

(20.0) 


4 

(20.0) 


5 

(25.0) 


Boston Area 


26 


0 

( 0.0) 


12 
(46.2) 


7 

(26.9) 


3 

(11.5) 


4 

(15.4) 


6 

(23.1) 


Government Subtotals 


115 


0 

(0.0) 


39 
(33.9) 


32 
(27.8) 


15 
(13.1) 


29 

, (25.2) 


34 
(29.6) 


TOTALS 


315 


5 

(1.6) 


174 
(55.2) 


63 
(20.0) 


21 
(6.7) 


52 
(16.5) 


57 
(18.1) 



*The numbers lu parentheses are the percentages of total mailed. 
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In reviewing the results of the BAS mailing in more detail, it was 
found that, of the 220 letters mailed, 115 were sent to small companies. 
Even though this represents 52.3% of the companies, only two of the 
twelve companies that participated in workshops were small. This 
represents a very poor 1.7Z participation level. 

Because of the mailing results, and the timetable constraint, it 
was decided to abandon the search for small companies and to use medium 
and large companies in the workshops for both the BAS and work 
motivation projects. (Actually, 13 of the 68 companies that 
participated in workshops were small by definition.) 

As mentioned previously, combining workshops was only a partial 
solution in obtaining enough participants for the workshops. In order 
to obtain the remaining workshop participants, personal contacts were 
uaed to obtain cooperation from a number of companies. In some cases,' a 
single company was willing to furnish enough participants for a 
workshop. In the other cases, the company furnished from one to five 
participants to attend workshops made up of participants from more than 
one company. 

Again, this represented a deviation from the proposed procedure in 
the following ways. These companies were not randomly selected but 
'*hand picked," based on personal contacts which the project 
investigators had with companies. Also, there were a number of "single 
company" workshops instead of a mix of companies at each workshop. 
After reviewing these deviations, it was felt that they were of minimal 
consequence since the companies contacted represented both a wide range 
in product and in size (small, medium and large), and the inputs from 
the engineers and managers seemed to be candid and diverse. 
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The contact/participation rate was dramatically improved via the 
personal contact approach* In total, forty-nine companies were asked to 
participate and forty-two agreed (85. 7%) • These contacts resulted in 
205 workshop participants. 

As was mentioned before, workshops with engineers and managers from 
governmental agencies were arranged for the work motivation project. 
Even though it was not originally planned to include governmental 
agencies in the BAS project, the decision was made to use some of them 
in order to increase the number of participants in the project and to 
increase the variety of employers* 

Given these modifications, the workshops were arranged for project 
phases I, II, and III* Due to the modifications, it was possible to 
increase the number of workshops conducted at each phase* Table 4 
summarizes the number of workshops held for each phase and Appendix A 
gives, in detail, the workshops and participating organizations* 

Phase IV of the project occurred after the data from Phases I, II 
and III were collected and evaluated* This information was then used to 
construct the necessary BAS scale for each factor identified as being an 
important component in the technical performance and updating of 
engineers (there were eleven such factors identified)* BAS scales were 
then to be used by managers of engineers to describe the technical job 
performance and updating of subordinate engineers* 

Instead of executing Phase IV in a workshop environment, as was 
originally proposed, it was decided that a mailing would be used to 
accomplish this phase of the project* The main reason for this 
deviation was the geographical dispersion of the individuals who were 
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Table 4 

Summary of Workshops Held for Each Phase 





Number of Workshops 




Total Number 


Participating 


Phase 


Single 
Organization 


Multl- 
Organlzatlons 


Total 


Organizations 


Individuals 


I 


6 


2 


8 


18 


66 


II 


4 


11 


15 


67 


133 


III 


9 


0 


9 


9 


88 


TOTALS 


19 


13 


32 


94 


287 



By comparing Tables 1 and 4, one can see that 32 workshops were held 
instead of the proposed seven and that input was received from 287 indivi- 
duals instead of the proposed 70-84 • 

The final data collection phase of the project. Phase IV, required a 
deviation from the proposed plan. 
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potential participants in this phase of the project. Of the total of 98 
persons contacted, 61 (62.2%) had been participants of workshops in 
Phase I, II or III. The remaining 37 (37.8%) had not participated in 
the project previously. Each manager was asked to rate two subordinate 
engineers, using the BAS scales. Of those contacted, 42 (42.8%) 
responded, having used the scales to describe 84 engineers. 
Sunnnary of Sampling Strategy 

Although a number of deviations were made from the proposed 
sampling procedure, it is felt that, in each case, the deviation was 
made for the betterment of the project. The actual sampling strategy 
produced a 457% (32 vs 7) increase in the number of workshops, a 210% 
(327 vs 156) increase in the number of participants, and a 181% (94 vs 
52) increase in the number of organizations over the numbers proposed in 
the original sampling strategy. 

Fifty-two of the 94 organizations (55.3%) which participated in the 
project were chosen randomly from various industrial directories. The 
remaining 42 organizations (44.7%) were chosen through personal contacts 
within the organization. Thus, the sampling strategy is not totally 
random. However, it is felt that the sample bias is minimal since the 
participating organizations ranged from small to large in size and 
represented a large variety of services and products. 



As a result of the first three workshops conducted in Phase I of 
the project, an initial set of ten factors related to updating in 



Results 



Phase I. Dimension Identification and Definition and 



Behavioral Statement Development 
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engineers was developed and tentative definitions of each factor were 
written. Participants in the first three workshops were mailed copies 
of the ten factors and definitions and asked for commentary. The set of 
factors and their definitions were also distributed for discussion at 
subsequent workshops* On the basis of the input from the various 
workshop participants, some of the initial factor definitions were 
modified, and an eleventh factor was added to the set« The final set of 
eleven factors and their definitions is shown in Table 5« 

Once the set of factors relevant to technical job performance and 
updating activities had been developed, it was necessary to develop for 
each factor a number of items on statements which gave behavioral 
examples relevant to the factor. These behavioral statements would 
serve as the set of potential scale anchors for each factor. 

These behavioral statements were developed from several sources* 
Some statements were written from notes of the discussions of the 
initial workshops which were the basis of the set of factors* 
Frequently, as part of the discussion of a particular factor, the 
workshop participants would describe the specific job behavior of an 
engineer relevant to the factor* A second source of behavioral 
statements was a mailing to a sample of 65 members of the American 
Society of Engineering Education* This mailing included a questionnaire 
which asked for behavioral examples of the job performance of the 
technically up-to-date engineer and for examples of the job performance 
of the technically obsolete engineer* Thirty individuals returned this 
questionnaire (46*2% of the sample)* A third source of the behavioral 
statements was workshop participants* Individuals in five workshops 
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Table 5 

Factors Related to Technical Job Performance and Updating In Engineers 

A. Technical Cocgnunicatiori - the ability to transmit and receive written 
and oral information related to technical projects and assignments. 

B. Scientific and Technical Knowledge - the possession of fundamental 
scientific, mathematical, and engineering knowledge necessary for 
adequate completion of a project or assignment. 

.C. Organization and Planning - the ability to manage projects, and 
assignments including establishing priorities, meeting deadlines, 
and attending to details. 

D* Problem Recognition and Definition - the ability to understand the 
cause (s) of the symptoms of a problem. 

£• Development of Alternative Solutions - the ability to create several 
possible solutions to a problem which are technically feasible. 

F« Evaluation of Alternative Solutions - the use of theoretical, analyti- 
cal, and empirical methods to determine the likely consequences of 
alternative solutions. 

C. Implementation of Chosen Alternative - the ability to make an alterna- 
tive operational by fitting the solution to the particular situation. 

H. Professional Activities - the extent to which the engineer participates 
in professional registration and society activities. 

!• Continuing Education Attempts - the type of procedure used by the 
engineer to maintain or obtain up-to-date technical skills. 

J» Work Assignments Sought - the type of job activities desired and 
pursued by the engineer. 

K* Technical Interest and Curiosity - The interest and curiosity shown 
by the engineer regarding technology, science,, and recent developments 
In both. 
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were asked for examples of the job performance of engineers related to 
the factors. Examples of above average, average, and below average 
levels of performance were solicited. 

The results from the various sources of input to this phase of the 
project were edited by the project staff to reduce redundancies among 
the behavioral statements and to write the statements in a common 
grammatical format. This editing process yielded a total of 240 
behavioral statements which were divided into two sets, each of which 
contained 120 items, for the next phase of the project. Appendices B 
and C present the two sets of behavioral items developed in this phase 
of the project. 

Phase II . Behavioral Statement Allocation 

The two sets of 120 behavioral statements described in the previous 
section were next administered to workshop participants who had had no 
previous contact with the project. Thes.?. participants were asked to 
clarify or allocate each behavioral statement in one of the two sets to 
one of the eleven factors related to the technical job performance and 
updating activities of engineers . Instructions • given to the 
participants are shown in Appendices B and C along with each set of 
statements. A participant allocated the behavioral statements in only 
one of the two sets or a total of 120 statements. Sixty-five 
participants allocated the statements given in Appendix B, and sixty 
allocated the statements in Appendix C. 

Following the gathering of the allocation data, a frequency 
tabulation was prepared. For each behavioral statement, the frequency 
of allocation to each factor was determined. Since a consensus of 
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allocation judgments was desired. It was decided to retain for further 
project work only those behavioral statements that were allocated to one 
performance and updating factor by a minimum of 60% of the participants. 
This allocation criterion resulted in the retention of a total of 1A8 
behavioral statements* The remaining 92 statements were dropped because 
of their apparent ambiguity with regard to what factor they represented. 

Appendix D shows the behavioral statements, organized by factor, 
which were retained for further project work. 
Phase Scaling of Behavioral Statements 

The behavioral statements shown in Appendix D were administered in 
a questionnaire to 88 participants in nine workshops. None of these 
participants had taken part in any of the earlier phases of the project. 
The participants were Instructed to rate on a nine-point scale each 
behavioral statement for all factors with regard to the level of 
performance or amount of the factor described by the statement. The 
specific instructions and the rating scale to be used are also presented 
in Appendix D* After the rating or scaling data were obtained from the 
88 workshop participants, mean ratings and associated standard 
deviations were computed for each behavioral statement and are also 
shown in Appendix D. As a result of the scaling phase, behavioral 
statements were chosen to anchor the rating scale to be developed for 
each of the eleven factors related to the technical job performance and 
updating activities of engineers. 

The criteria used for choosing behavioral statements to be used as 
scale anchors were several* First, for each factor the relevant 
behavioral statements were grouped into three classes: (a) more than an 
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adequate level of performance or amount of the factor; (b) an adequate 
level of performance or amount of the factor; and (c) a less than 
adequate level of performance or a'iiount of the factor* Statements were 
grouped into one of the three classes on the basis of the mean rating 
given by the workshop participants, with statements with a mean rating 
of greater than 6.5 being grouped in the more than adequate category and 
statements with a mean rating of less than 3*5 being grouped in the less 
than adequate category. Within each of these three general classes, it 
was desired to select from two to four behavioral statements to act as 
specific examples of the general class. Within each general class, 
statements with the smallest standard deviations were chosen to be used 
as anchors with the additional criterion of content variability, i.e., 
it was desirable that a set of anchors have heterogeneous content rather 
than homogeneous content. In a few instances, only a single example for 
a given level which met all the criteria was available. Table 6 
presents the final set of rating scales developed for the eleven factors 
related to the technical job performance and updating activities of 
engineers . 

Phase IV . Use of the Rating Scales 

Two sets of the rating scales for the eleven factors were sent to 
98 individuals, of whom 61 had participated in an earlier phase of the 
project and 37 had not« All supervised other engineers. These 
individuals were asked to evaluate two of their subordinate engineers 
anonymously and to provide some demographic information on the rated 
engineers. Appendix E presents the instruction sheet and demographic 
information questionnaire which accompanied the set of rating scales* 



36 



27 



(b) an adequate 
(c) a less than 
Statements were 
the mean rating 
.th a mean rating 
[uate category and 
ouped In the less 
meral classes. It 
ements to act as 
;h general class, 
chosen to be used 
variability, i.e., 
lus content rather 
dngle e:cample for 
liable. Table 6 
he eleven factors 
ng activities of 

ors were sent to 
ier phase of the 
ngineers . These 
rdinate engineers 
ion on the rated 
and demographic 
rating scales. 



Table 6 

Final Rating Scales for the Eleven Factors Related to 
Technical Job Performance and Updating Activities of Enginee 
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Factor A, 
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Technical Coramunication - the ability to transmit and receive written 
and oral information related to lechnical projects and assignments 



Nuoerlcal 
Scale 

9 -I 



8 



- 7 



6 



- 5 



more than adequate 
^ or acceptable 
typical performance 
on this factor 



Examples of Performance 



Can tailor technical presentations to fit the 
audience 

Is able to instruct other engineers in new 
technology 

Can sell a technical improvement to management 
which is initially opposed to change 

Is able to ask questions of technical experts 
which obtain the appropriate and needed 
information 



* 4 



adequate or acceptable 
• typical performance 
on this factor 



- 3 



less than adequate 
^ acceptable 

typical performance 
on this factor 



Reports only the information pertinent to the 
problem at hand 

Communicates well only with engineers within 
his or her specific technical discipline 



- Writes technical reports which are too wordy 

- Has difficulty documenting technical .results 

- Rarely contributes information to engineering 

staff discussions of technical problems 

- Frequently has a proposed project rejected by a 

manager because of a poor presentation 



Numerical Description for this Factor 



Specific instance(s) of this Individual's work activities related to this factor: 
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Factor B. 



Kumerlcal 
Scale 



30 

Scientific and Technical Knowledge - the possession of fundamental scientific, 
mathematical, and engineering knowledge necessary for adequate' completion of 
a project or assignment 



Examples of Amounts of this Factor 



9 -1 



' 8 



- 7 



more than an 
^ adequate or acceptable 
* typical amount of 
this factor 



- Performs assignments with minimum supervision 

- Is considered the technical expert In the department 



6 



an adequate or 
acceptable 
typical amount of 
this factor 



- Has a good working knowledge of calculus ^d 

differential equations 

- Has fundamental grasp of heat transfer and thermo- 

dynamics 

- Is aware of re int solid state technology 

- Understands statistical Inference and sampling 

techniques 



less than an 
adequate or acceptable 
typical amount of 
this factor 



1 -J 



Sometimes makes mathematical errors on an 
assignment 

Is unfamiliar with the precise tecl\nical defini- 
tions of toany scientific terms 

Often needs technical help from colleagues in 
order to complete an assignment 

Has difficulty understanding basic electronic 
designs 



— Numerical Description for this Factor 

Specific insr,ance(s) of this Individual's work zcti^±z±es related to this factor: 



EKLC 
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Factor C. Organization and Planning - the ability to manage projects., and assignments 

Including establishing priorities, meeting deadlines, and attending to details 



Humerical 
Scale 



Examples of Performance 



• 8 



- 7 



9 -I 



no re than adequate 
^ox acceptable 
typical performance 
oa this factor 



- 6 



• 5 



* 4 



■ 3 



adequate or acceptable 
• typical performance 
on this factor 



- Prepares schedules identifying project milestones 

- Is capable of reorganizing a project due to 

schedule or technical specification changes 

- Able to establish project priorities without the 

specific guidance of the supervisor 

- Offers ideas developed from current projects as 

proposals for possible future projects 



- Sometimes misses non-critical project deadlines 

- Is able to use systematic scheduling procedures 

such as Gantt and PERT methods 

- Spends too much time on details 



■ 2 



1 



less than adequate 
. or acceptable 

typical performance 
on this factor 



Does not follow up through Implementation after 
the major components of a project are completed 

Often misses deadlines for completing an assignment 



Uses excessive manpower and equipment resources 
due to poor project management 



- Drags out each assignment to the maximum 



Numerical Description for this Factor 



Specific Instance(s) of this individual's work activities related to this factor: 



EKLC 
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Factor D. Problem Recognition and Definition - the ability to understand the 
cause (s) of the symptoms of a problem 

Numerical 

^^^^ Examples of Performance 



9 -1 



8 



- 7 



- 6 



• 5 



nore than adequate 
^ or acceptable 
typical performance 
on this factor 



Able to recognize the existence of a technical 
problem before all the negative symptoms are 
apparent 

Is able to identify a specific problem as being an 
example of a general class of problems which 
has certain possible solutions 

Goes to the location of a problem to get direct 
Information about it 

Able to distinguish between symptoms and causes 
of a problem 



- 4 



adequate or acceptable 
• typical performance 
on this factor 



- 3 



1 -J 



less than adequate 
or acceptable 
typical performance 
on this factor 



Accepts other people's opinions about the cause 
of a problem 



Usually determines the cause of a problem as the 
project progresses 



Often attacks the first symptoms of a problem, 
rather than looking for its real causes 

Often misses one or two Important factors in a 
problem 

Usually is not able to see which problem 

sjnnptoms are related to each other and treats 
each symptom as if it were a separate problem 



Numerical Description for this Factor 



Specific instance(s) of this individual's work activities related to this factor: 
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Factor E. Development of Alternative Solutions - The ability to create several 
possible solutions to a problem which are technically feasible 



Numerical 
Scale 



Examples of Performance 



8 



- 7 



9 -1 



more than adequate 
^ or acceptable 
typical performance 
on this factor 



- Is always looking for a better way to do a job 



Usually offers several solutions to a technical 
problem for management to choose from 



Creates imaginative solutions to long-term 
problems 



- 5 



adequate or acceptable 
- typical performance 
on this factor 



Develops a second approach to a problem only 
when the first approach fails 



Requires prompting by the supervisor to look 
for more than one possible solution to a 
problem 



* 4 



• 3 



- 2 



1 



less than adequate 
^ or acceptable 

typical performance 
on this factor 



Will propose and defend the first solution to 
come to mind 



Doesn't consider challenging the "status quo" 
of a traditional approach to an engineering 
problem 



Numerical Description for this Factor 



Specific Instance (s) of this individual's work activities related to this factor: 



EKLC 
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Factor F. 



Ncaserlcal 
Scale 



Evaluation of Alternative Solutions - the use of theoretical, analytical, 
and empirical methods to determine the likely consequences of alternative 
solutions 

Examples of Performance 



8 



- 7 



- 6 



9 



more than adequate 
^ or acceptable 
typical performance 
oa this factor 



Selects a solution based upon well-documented 
analysis 



Attempts to quantify all costs and benefits 
associated with the possible consequences 
of proposed solutions 



Quickly finds the strong and weak points of 
alternatives 



adequate or acceptable 
typical performance 
oa this factor 



Does not prejudge any possible solution before 
the evaluation data are complete 



less than adequate 
^ or acceptable 

typical performance 
on this factor 



- Sometimes cannot point out the comparative 
advantages and disadvantages of two 
alternatives 



1 - 



Numerical Description for this Factor 



Specific Instance(s) of this ind?.vidual's work activities related to this factor: 



EKLC 



43 



35 



Factor G. Implementation of Chosen Alternative - the ability to make an alternative 
operational by fitting the solution to the particular situation 



Huaerlcal 
Scale 



Examples of Performance 



8 



- 7 



9 



more than adequate 
^or acceptable 
typical performance 
on this factor 



- Is prepared to accept minor changes in solution 

in order to gain its implementation 

- Anticipates implementation problems and plans 

for their solution 

- Can usually overcome small obstacles to the 

implementation of a solution 



- 6 



adequate or acceptable 
• typical performance 
on this factor 



Forces the chosen alternative solution into 
operation, compromising some of the desired 
goals of the project 

Is able to make an idea operational although 
it may not function at rated capacity 

Expects every solution to work as smoothly as 
possible upon implementation 



less than adequate 
^ or acceptable 

typical performance 
on this factor 



Sticks with the original solution for too long, 
until it is not working in a satisfactory 
manner 

Tries to implement a new production line layout 
before being sure that production management 
fully understands it 

Rigidly adheres to textbook solutions without 
considering the specific situation 



•1 



_ Kuncrlcal Description for this Factor 



Specific instance (s) of this individual's work activities related to this factor: 



EKLC 
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Factor H. Professional Activities - the extent to which the engineer participates 
in professional registration and society activities 



NuEBerlcal 
Scale 

9 



8 



+ 7 



- 6 



• 5 



more than usual amount 
«of typical activity 
or effort related to 
thla factor 



E3camples of Activities Related to this Factor 



Usually presents a paper at a regional or 

national technical society meeting each year 

Teaches a refresher course for the local 

professional society chapter 

Seeks leadership roles in professional 
societies 



- 4 



usual amount 
^of t3rpical activity 
"or effort related 

to this factor 



- Has never submitted a paper for presentation 

at a technical society meeting 

- Attends most chapter meetings of the technical 

society 



- 3 



1 -J 



less than usual amount 
^of typical activity 
""or effort related to 
this factor 



Joins professional societies solely to pad the 
resume 



• Has no interest in professional registration 



Numerical Description for this Factor 



Specific instaace(s) of this individual's work activities related to this factor: 
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Factor I. Continuing Education Atteinpts - the type of procedure used by the 
engineer to maintain or obtain up-to-date technical skills 



Humerical 
Scale 



Examples of Activities Related to this Factor 



* 8 



+ 7 



9 -I 



more than usual amount 
«of typical activity 
or effort related to 
this factor 



Devotes a substantial portion of spare time 
to reading technical publications and 
taking technical courses 

Has made definite plans for self -development in 
technical areas 

Enrolls in university courses on advanced 
technical topics 

Attends as many company-sponsored technical 
seminars and short, courses as possible 



6 



• 5 



^lsual amount 
of typical activity 
'or effort related 
to this factor 



Expects the organization and its management to 
initiate all continuing education efforts 



Rarely enrolls in technical courses or seminars 
held outside the company 



- 4 



- 3 



* 2 



•1 



less than usual amount 
^of typical activity 
or effort related to 
this factor 



- Never attends an in-house technical seminar 

- Reads technical literature only when told to 

by the supervisor 

- Frequently content to rely upon co-workers 

for learning about new techniques 



Numerical Description for this Factor 



Specific instance(s) of this individual's work activities related to this factor: 



er|c 
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Factor J. Work Assignments Sought 
by the engineer 
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- the type of job activities desired and pursued 



numerical 
Scale 

9 -1 



8 



- 7 



- 6 



Bore than usual amount 
•of typical activity 
or effort related to 
this factor 



^^3camples of Activities Related to this Factor 



Prefers assignments which Involve several 
technical disciplines 

Is willing to accept an assignment which has 
an uncertain chance of success 

Tries to get assignments which focus on different 
applications of a specific technical interest 

Tells the supervisor of interest in attending 
technical seminars 



usual amount 
^of typical activity 
"or effort related 

to this factor 



- Tends to remain with assignments in which he 

feels comfortable 

- Desires assignments which are more administra- 

tive than technical 

- Never expresses reluctance to accept an 

assignment 



•1 -J 



less than usual amount 
^of typical activity 
*or effort related to 

this factor 



- Prefers to work on rat.ier routine and mundane 

assignments 

- Is content to remain in current job for an 

indefinite amount oi time 

- Tries to avoid assignments in unfamiliar 

technical areas 



Kumerlcal Description for this Factor 



Specific instance(s) of this individual's work activities related to this factor: 
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Factor K. Technical Interest and Curiosity - The interest and curiosity shown by the 
engineer regarding technology, science, and recent developments in both 



Numerical 
Scale 



Examples of Amotmts of this Factor 



" 8 



7 



9 



' 5 



• 4 



■ 3 



• 2 



more than an 
adequate or acceptable 
typical amount of 
this factor 



- Is curious about all technical areas 



- Is excited about technical developments 



- Works extra hours on own initiative 



an adequate or 
acceptable 
typical amount of 
this factor 



Sometimes displays a negative attitude toward 
new Ideas 



Occasionally reads Journals in related technical 
areas 



less than an 
adequate or acceptable 
typical amount of 
this factor 



- Is pessimistic and cynical about new technical 

developments 

" Has little curiosity about technologies related 
to own 

- Is bored with job 

- Adopts an attitude of "if It's Important, 

someone will tell me about It" toward 
developments 



Numerical Uescripcion £^r this Factor 



Specific instenceCs) of cJ: la individual's work activities related to this factor: 
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Data were received from 42 Individuals or a total of 84 rated 
engineers of which 82 were usable* Means, standard deviations, and 
intercorrelations were computed for the ratings on the eleven factors* 
Table 7 presents the means and standard deviations of the ratings* 
Table 8 presents the intercorrelations among the eleven ratings* The 
median intercorrelation among the ratings was *38* 

The typical engineer who was rated in this phase of the project was 
described on the demographic information sheet as having a bachelor^s 
degree, being under the age of 40, and having been with the current 
organization from one to seven years* About two-thirds of the ratees 
were in the fields of mechanical, industrial, and electrical 
engineering* The supervisor who rated them had typically been the 
engineer's superior for several years* 

Discussion 

The objectives of the project appear to have been realized by its 
outcomes* The set of BAS instruments is an appropriate instrument for 
obtaining evaluations "Of engineers' technical proficiencies and 
technical updating attempts* The psychometric characteristics of the 
data obtained in Phase IV of the project suggest that the BAS developed 
for the eleven factors related to the technical job performance and 
technical updating activities of enginneers are quite satisfactory 
measurement devices* The scale intercorrelations were in general low to 
moderate, thus avoiding the problem of strong halo that is common with 
many rating scales* Halo is the tendency of a rater to give highly 
similar evaluations on all rating dimensions to the ratee which results 

^ /to 
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Means and Standard Deviations of the Ratings 
on the Eleven Factors 
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Factor 

A. Technical Communication 

B. Scientific and Technical Knowledge 

C. Organization and Planning 

D. Problem Recognition and Definition 

E. Development of Alternative Solutions 

F. Evaluation of Alternative Solutions 
C. Implementation of Chosen Alternative 

H. Professional Activities 

I. Continuing EduCaclon Attempts 
J. Work Assignments Sought 

K. Technical Interest and Curiosity 



Mean 

«.60 
6.86 
6.39 
6.87 
6.54 
6.48 
6.81 
4.62 
6.38 
7.02 
7.01 



S.D. 

1.49 
1.50 
1.71 
1.34 
1.45 
1.33 
1.28 
2,05 
1.46 
1.32 
1.32 



Note: N=82 
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Table 8 

Intercorrelations among the Ratings of the Eleven Factors 



Factor 


B 


C 


D 


E 


F 


G 


H 


I 


J 


K 


A 

A 




• 48 


• 41 


.57 


.36 


.48 


.20 


.35 


.54 


.40 


u 
o 




.23 


• 61 


.50 


.40 


.32 


.06 


.46 


.42 


.53 








• 34 


. .36 


.41 


.29 


.20 


.23 


.44 


.27 


D 








.62 


.49 


.35 


.07 


.15 


.27 


.24 


E 










.49 


.34 


.17 


.32 


.43 


.38 


F 












.44 


.15 


.20 


.47 


.42 


G 














.06 


.27 


.53 


.39 


H 
















.44 


.24 


.12 


I 


















.48 


.39 


J 




















.56 



Note: N*82 
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in very high rating scale intercorrelations. The factors and scales 
apparently are sufficiently well-defined and meaningful to the raters 
that they are able to distinguish among the various dimensions of 
performance and updating and can differentiate the relative strengths 
and weaknesses of their subordinate engineers* 

The means of the ratings obtained in Phase IV are generally above 
the midpoint of the nine-point scale used with the BAS. This could be 
interpreted as evidence for leniency error, that is, the tendency of 
raters to rate the ratees more favorably than might be objectively 
v-rranted. However, it is probably reasonable to expect that the mean 
rating received by a group of engineers who typically had been employed 
for several years with an organization would be above average. That is, 
the objective mean performance level of the rated group is likely to be 
better than average so that the mean rating of their performance also 
should be above average. Thus, the finding that the mean rating 
exceeded the scale midpoint is not surprising and may well reflect the 
true performance level of the rated group. However, the possible 
existence of some leniency error cannot be ruled out. The standard 
deviations of the various ratings were of sufficient size to indicate 
that the raters had differentiated adequately among the ratees. Small 
standard deviations would have indicated that every ratee had received 
about the same evaluation and, thus, the BAS had not been used to make 
comparative judgments about the various ratees. A measurement 
instrument is of little value as a diagnostic device if everyone 
receives approximately the same score or rating. 

er|c 



The various goals of the present research project in terms of 
possible uses of the BAS Instruments which were developed also appear to 
have been met» The BAS Instruments should be useful In the evaluation 
of the need for technical updating among the engineers of an 
organization. They should aid the technical supervisor In the difficult 
task of providing accurate and meaningful feedback to subordinate 
engineers about their technical strengths and weaknesses. The scales 
should also be helpful in planning for the continued professional 
development of the engineers* 

A basic tenet of the present project was to develop a set of rating 
scales which could be used in many organizations with engineers in many 
different disciplines* Thus, the procedures employed by the project 
were well suited* The generalizability of the resulting BAS should be 
good because of the large numbers of organizations, engineers, and 
engineering fields in the project sample* 

The BAS scales which emerged from the careful development process 
have several desirable measurement properties* They are reasonably 
"objective" instruments designed for a very subjective problem* The use 
of agreement statistics as criteria for inclusion of the behavioral 
examples as anchors on the various scales reduces the amount of 



ambiguity provided by most types of rating scale anchors* The reliance 
upon behavioral examples as scale anchors permits the rater to move away 
from global and vague concepts such as "average" or "excellent" toward a 
more concrete and specific description of the behavior of the ratee* 
The scales also provide for the generalizability of their use due to the 
inclusion of many different groups of engineers and organizations in the 
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developmental process* Thus, the results of scale development are not 
dependent upon the (perhaps) idiosyncratic judgments of a single group* 

The BAS approach has several advantages when compared to possible 
alternatives for the development of updating measures* It focuses upon 
specific, observable behaviors of engineers rather than discussing the 
issue of continuing education needs in vague, ambiguous terms. The 
method is predicated upon a form of consensual validation, i*e*, each 
step in the process of developing the measuring instruments requires 
that subject matter experts agree upon the particular decision to be 
made at that step* Thus, the resulting instruments represent dimensions 
of continuing education needs anchored by specific behavioral items at 
various levels of the dimension which have been agreed upon by the 
participants in the development process* The instruments are not the 
product of a few individuals with little or no expertise in the content 
area, but rather represent a broad opinion of informed and experienced 
engineers and supervisors* A potential disadvantage is that minority 
views, which may be valid, may tend to be dropped by the process due to 
the agreement criteria* If it is accepted that general instruments are 
desired, however, then the loss of somewhat idiosyncratic opinions is 
not a serious problem* 

The use of a diverse sample o£ individuals, organiz^.tions, and 
disciplines does result in a set of measurement instruments that must be 
at a fairly general level* That is, the use of only the BAS developed 
in this project cannot inform a supervisor about the exact nature of :he 
technical updating which a subordinate engineer needs in order to 
perform the job more competently* In order to establish the precise 




content of the updating requirement. It would be necessary to develop a 
set of BAS for each engineering discipline and each type of job 
assignment within each discipline. The set of BAS developed in this 
project can alert the supervisor and engineer to a potential technical 
deficit, but the task of specifying the knowledge or skill which Is 
needed remains for them to establish. 
Research and Application 

The BAS Instruments developed In the present project appear to be 
psychometrlcally sound and useful devices. However, the scales have not 
yet been applied In an operational setting to determine If supervisory 
personnel and their subordinate engineers can use them as aids to the 
process of developing professional education plans. Such use of the 
scales is really the "acid test" of their utility to organizations and 
engineering personnel. It would be of great Interest to investigate the 
effect of using the BAS as a performance appraisal and feedback device 
over a period of time on the performance, technical updating, and career 
development programs of the engineers. 

More basic data on the scales should be obtained. More raters 
should evaluate subordinate engineers . so that the scale 
Intercorrelatlons, means and standard deviations can again be calculated 
as a replication of the findings presented in this report. It would 
also be desirable to obtain inter rater agreement data, that is, to have 
two raters each evaluate the same set of ratees. The degree of 
agreement among the two raters can then be calculated. It was intended 
to obtain such data in the present project, but the samples of 
organizations and indlvi'fuals which were available for data collection 

5Tr 



did not permit It. There were too few Instances In which there were two 
raters who knew a connnon set of subordinate engineers well enough to 
provide meaningful evaluations. The value of such data Is that 
Information Is tht^n available on the extent to which the BAS ar-^. able to 
elicit similar evaluations from two raters* If the scale dimensions and 
anchors are sufficiently objective and non-ambiguous, there should be 
good agreement among dlfferer.t raters. 

The BAS Instruments developed in the present project should also be 
used as dependent variables future research concerned with 

organizational and ladlvldual faci.>.i:s that affect the technical 
performance and updating of engineers. Instruments developed in the 
National Science Foundation funded Grant Number SED78-21941 entitled, 
"Relationships Among Individual Motivation, Work Motivation and Updating 
in Engineers," conducted by the present project staff, should be used in 
conjunction with the BAS to investigate this area of Interest. Such an 
investigation should be longitudinal in nature so as to study the long- 
term, as well as short-term, effects of the work environment and 
individual motivation on technical updating and performance. This type 
of study will provide valuable information about how an organization can 
positively Influence the technical updating and job performance of its 
engineers and how an organisation can avoid inhibiting desirable levels 
of these behaviors. 
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APPENDIX A 

Organizations Participating in Each Phase of Workshops 
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NUMBER OF ENGINEERS 

WORKSHOP ID AND LOCATION ORGANIiJATIONS PARTICIPATING PARTICIPATING 



I - 1 

State College, PA 
3-12-79 



Applied Research Laboratory 2 

Cerro Metal Products 1 

Centre Engineering, Inc. 1 

H R B - Singer, Inc. 2 

Management Engineering 1 
The Pennsylvania State University 

Sutton Engineering Company 3 



1-2 

State College, PA 
3-14-79 



H R B - Singer, Inc. 
C. H. Masland and Son 
Coming Glass Works 
Piper Aircraft, Inc. 
Sperry New Holland 
Sprout Waldron Koppers 
Standard Steal Division, TMCA 



1 
2 
1 
2 
2 
1 
2 



1-3 

Altoona, PA 

3- 22-79 

1-4 

New Holland, PA 

4- 23-79 

1-5 

Lancaster, PA 
4-24-79 

1-6 

Hershey, PA 
4-24-79 

1-7 

West Point, PA 

4- 30-79 

1-8 

Moorestovn, NJ 

5- 1-79 



Consolidated Rail Corporation 



Sperry New Holland 



Armstrong Cork Corporation 



Hershey Chocolate Company 



Merck, Sharp & Dohme 



RCA 
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WORKSHOP ID AND LOCATION ORGANIZATIONS PARTICIPATING 



NUMBER OF ENGINEERS 
PARTICIPATING 



II - 1 

Cleveland, OH 
5-3-79 



Cleveland Twist Drill Company 
Joy Manufacturing Company 
Parker Hannifin Corporation 
Scott & Fetzer Company 



2 
1 



II - 2 

Cleveland, OH 
5-4-79 



Republic Steel Corporation 



II - 3 
Warren, OH 
5-4-79 



Packard Electric 



II - 4 

Rochester, NY 
5-9-79 



Xerox Corporation 



II - 5 

Rochester, NY 
5-9-79 



Eastman Kodak Co. 



11 



II - 6 

Pittsburgh, PA 
5-24-79 



Bloom Engineering Co . , Inc . 1 

Pennsylvania Dept. of Environmental 1 
Resources 

Pennsylvania Dept. of Transportation 2 

U.S. Army Corps of Engineers 2 

U.S. Department of Housing & Urban 1 
Urban Development 
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WORKSHOP ID AXD LOCATION 



ORGANIZATIONS PARTICIPATING 



NUM3ER OF ENGINEERS 
PARTIC I PAT ING 



II - 7 

Pittsburgh, PA 
5-25-79 



II - 8 
BostoQy MA 
6-4-79 



Koppers Co., Inc. 2 

Matthews International Corporation 1 

Neville Chemical Co. 1 

Ualversal-Cydops Specialty Steel 

Division 2 

Massachusetts Bureau of Building 

Construction 2 

Massachusetts Dept. of Labor & Industries 

Division of Occupational Hygiene 2 

Massachusetts Dept. of Public Works 1 

Massachusetts Division of Air & 



Hazardous Materials 

Massachusetts Division of Water 
Pollution Control 

U.S. Department of Transportation 
Transportation Systems Center 



1 
1 



II - 9 

Hev York, NY 

6-5-79 



II - 10 

Williamsport, PA 
6-7-79 



Canrad-Hanovla, Inc. 

Grunsnan Aerospace Corporation 

Hoke, Inc. 

LevltOQ Mfg. Co., Inc. 
Sperry Division Headquarters 
Thomas J. Lip ton. Inc. 
Weston Instruments 
Wilbur B. Driver Co. 

Kavneer Company 
Marathon Carey McFall Co. 
Pennsylvania House Furniture Co. 
Shop-Vac Corporation 
TRW, Inc. 

Wels Markets, Inc. 
Zenith Audio Division 



2 
1 
2 
2 
2 
3 
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UOBKSHOP ID AND LOCATION 



ORGANIZATIONS PARTICIPATING 



NUMBER OF ENGINEERS 
PARTICIPATING 



II - 11 
Allen town, PA 
6-11-79 



II - 12 

Barrlsburg, PA 
6-12-79 



Air Products & Chemicals, Inc. 
Fuller Co. 

General Electric Co. 

IngersoU - Rand Co« 

Hack Trucks, Inc« 

Nev Jersey Zinc 

Pennsylvania Power & Light Co« 

Zntemational Signal & Control 

Hev Cumberland Army Depot 

Pennsylvania Dept. of Environmental 

Resources, Bur. of Water Quality Mgt. 

Peimsylvanla Dept« of Transportation 

Pennsylvania Public Utility Commission 

Pennsylvania Turnpike Commission 



II - 13 

Barrlsburg, 

6-12-79 



PA 



Pennsylvania Dept. of General Services 1 
Hamilton Technology X 
Pennsylvania Dept. of Transportation 5 



II - 14 
Erie, PA 
6-15-79 



II - 15 

Washington, DC 
6-19-79 
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American Sterilizer Co. 

Copes-Vulcan, Inc. 

Corry Jamestown Corporation 

Geosource, Inc. 

Bucyrus Erie Co. 

General Electric Co. 

Teledyne Penn Union 

Zun Industries 

Federal Aviation Administration 

U«S« Department of Energy 

U.S. Department of Transportation 
Research & Special Programs Admin < 

U.S. Department of Transportation 
Urban Mass Transportation Admin. 

U.S. Defense Nuclear Agency 
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2 
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WORKSHOP ID AND LOCATION 
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NUMBER OF ENGINEERS 
ORGANIZATIONS PARTICIPATING PARTICIPATING 



III - 1 

Belleville, PA 
8-9-79 



Sperry New Holland 



12 



III - 2 
Burnham, PA 
8-9-79 



Standard Steel Division, TMCA 



III - 3 
Allqulppa, PA 
8-13-79 



J & L Steel 



III - 4 
Warren, OH 
8-13-79 



Packard Electric 



III - 5 
Alliance, OH 
8-14-79 

III - 6 
Bethlehem, PA 
8-20-79 



Babcock & Wilcox Research Center 



Bethlehem Steel Corporation 



12 



15 



III - 7 
Allentown, PA 
8-20-79 



Air Products & Chemicals, Inc. 



Ill - 8 
Newark, OH 

III - 9 

State College, PA 



Rockwell International 



H R B-Slnger, Inc. 



9 

9 
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APPENDIX B 

First Set of 120 Behavioral Statements Developed for 

Factor Allocation 
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Examples Describing the Job Performance of Engineers 

Listed below are some examples which describe how an engineer might 
perform his ' her job. We are interested in your judgment about which 
factor related to updating in engineers is most relevant to each example. 
That is, we would like for you to classify or assign each example to the 
updating factor to which that example seems most applicable. 

Read over carefully the eleven factors related to updating in engineers 
on the form you have been given. Then, for each example listed below, write 
in the space to the left of the example the letter code of the factor which 
you think the example best represents or describes. 

To illustrate this better, suppose that example 1 was: 

i. Writes technical reports which are readily understood by 

organizational management. 

If you wrote an "A" in the space to the left of the example, this would mean 
that you believe that this example best represents or describes the factor 
of Technical Communication. 

Do this for all of the examples listed below. Please do not skip any 
examples. 

1. Has difficulty documenting technical results. 

2. Usually has analytical back-up for decisions which have been made. 

3. Prepares schedules identifying project milestones. 



4. Usually works on interesting projects first without regard for 
other priorities. 

5. Can adequately explain a technical problem to peers. 

6. Is able to meet the cost and time schedules of most projects. 

7. Generally has difficulty determining the consequences of a solution, 

8. Is able to list almost all potential causes of the symptoms of a 
problem. 

9. Can sell a technical improvement to management which initially is 
opposed to the change. 

10. Never attends an in-house technical seminar. 

11. Is able to make an idea operational although it may not function 
at rated capacity. 

12. Usually solves problems by a trial and error approach. 
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13. Is able to specify the operational characteristics of a piece 
of equipment needed for a projects 

14. Is frequently asked to make oral presentations to higher management 
concerning technical matters. 

15. Usually determj.nes the cause of a problem as the project progresses. 

16. Determines the possible consequences of the chosen solution, but 
not those of alternatives. 

17. Develops a second approach to a problem only when the first approach 
fails. 

18. Forces the chosen alternative solution into operation, compromising 
some of the dv sired goals of the project. 

19. Accepts work assignments as given. 

20. Is uncomfortable with the use of probabilistic methods in problem 
solving. 

21. Uses frequently the organization's technical library. 

22. Seeks new technical skills when required by an assignment. 

23. Skims technical journals and reads those articles relevant to 
Current projects. 

24. Has difficulty getting new projects started. 

25. Develops graphs, diagrams, and calculations for the evaluation 
of alternatives. 

26. Drags out each assignment to the maximum. 

27. Usually understands technical material with one reading. 

28. Knows the appropriate sources for necessary technical information. 

29. Enrolls in university courses on advanced technical topics. 

30. Often has only a vague idea about how much time each part of a 
project will require. 

31. Uses mathematical techniques of maximizing or minimizing alternative 
functions to develop options. 

32. Applies statistical models to develop simulation studies of alterna- 
tives. 

33. Has a good working knowledge of calculus and differential equations. 

34. Is able to use systematic scheduling procedures such as Gantt and 
PERT methods. 
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35, Is able to identify a specific problem as being an example of a 
general class of problems which has certain possible solutions, 

36, Discusses with the supervisor his or her interest in assignments 
involving computer-based analytical methods, 

37, Tries to implement new production line layout before being sure 
that production management^^^derstands it fully, 

38, Communicates well only with engineers within his or her specific 
technical discipline, 

39, Creates imaginative solutions to long-term problems, 

40, Often makes changes that merely manage the symptoms of a problem, 

41, Is knowledgeable about technical methods which fir£?t appeared in 
relevant engineering textbooks about ten years ago. 

42, Can adequately develop a project which was given in only general 
terms and with vague goals, 

43, Rigidly adheres to textbook solutions without considering the 
specific situation, 

44, Attends technical presentations suggested by the supervisor. 

45, Usually follows the technical suggestions of others without. first 
questioning their appropriateness, 

46, Can delegate appropriate parts of a project to other personnel ♦ 

47, Offers ideas developed from current projects as proposals for 
possible future projects, 

48, Often needs someone else to clean up the details of an assignment. 

49, Must always offer excuses for why a project is not completed on 
time, 

50, Rarely can develop more than one possible solution to a technical 
problem. 

51, Seeks the ideas of knowledgeable co-workers when faced with a 
difficult assignment, 

52, Uses statistical inference as basis for choosing alternatives, 

53, Sometimes is not able to foresee problems which may be encountered 
in a project, 

54, Usually is not able to see which problem sjrmptoms are related to 
each other and treats each symptom as if it were a separate problem 
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55. Sometimes is able to apply to assignments Information obtained at 
a professional society lecture. 

56. Tries to get assignments which focus on different applications of 
a specific technical Interest. 

57. Rarely sees any possible use of new technical methods. 

58. Frequently has a proposed project rejected by a manager because ot 
a poor presentation. 

59. Attends seminar series on microprocessors on own time. 

60. Usually discusses technical problems with other engineers following 
the regular staff meeting. 

61. Frequently has project proposals accepted after the first presenta- 
tion with lit::le revision necessary. 

62. Sometimes makes mathematical errors on an assignment. 

63. Has the ability to complete daily project routine despite occasional 
interruptions. 

64. Is able to get a new production line into operation on time and 
within quality control standards. 

65. Teaches a P.E. refresher course for the local professional society 
chapter. 

66. Has never become an E. I«T. 

67. Is content to remain in current job for an indefinite amount of 
time. 

68. Periodically attends technical seminars at own expense. 

69. Sometimes displays a negative attitude toward new ideas. 

70. Writes technical reports which are too wordy. 

71. Is able to ask questions of technical experts which obtain the 
appropriate and needed information. 

72. Usually spends some time actually observing the problem or situation 
before developing a solution. 

73. Sometimes cannot point out the comparative advantages and disadvantages 
of two alternatives. 

74. Is pessimistic and cynical about new technical developments. 
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75. Occasionally reads journals in related technical areas. 

76. Is not aware of recent: solid stute technology. 

77. Constantly readjust? the schedule of a project to allow for more 
time for its completion. 

78. Works extra hours on ovi initiative. 

79. Often misses oie or two important factors in a problem. 

80. Usually thinks of alternative solutic but needs some direction 
to fully develop **hem. 

81. Usually attends the meetings of the local technical society. 

8?. Is able to understand and apr^.y state of the art technology after 
an explanation by a more knowledgeable engineer. 

83. Doesn't adapt well to rapid change in technology. 

84. Failed to understand a technical paper resulting in the misapplica- 
tion of a new method to a problem. 

85. Is curious about all technical areas, 

86. Rarely talks to colleagues e.bout technical developments » 

87. Follows a program of professional development which his or her 
supervisor sugjestsd. 

88. Has never submitted a prper for presentation at a technical society 
meeting. 

89. Relies usually on traditional methods of engineering design. 

90. Is excited about technical developments. 

91. Desires assignments which are uore administrative than technical. 

92. Voluntc^rxs to give talks on new technical developments to 
engineers employed in I he organization. 

93. Has made definite plans for self -development in technical areas. 

94. Tends to remain with assignments in which he feels comfortable. 

95. Is willing to accept an assignment vhich has an uncertain chance 
of success. 

96. Is willing to admit a lack of knowledge in 3 technical area. 
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97. Often needs technical help from colleagues in order to complete 
an assignment. 

98 • Always takes the same approach to engineering design tasks. 

99. Is rarely consulted by co-workers for technical knowledge. 

100. Usually won^t make technical decisions about a project without 
first getting information from peers and the supervisor. 

101.. Rarely contributes information to engineering staff discussions 
of technical problems. 

102. Tries to avoid assignments in unfamiliar .technical areas. 

103. Tries to make contacts at technical society meetings with other 
engineers working in similar areas. 

104. Is able to instruct other engineers in new technology. 

105. Is unfamiliar with the precise technical definitions of many 
scientific terms. 

106. Does not follow up through implementation after the major 
components of a project are completed. 

107. Is registered as a P.E. 

108. Seeks to understand the process or system in which a technical 
problem has occurred. 

109. Selects a solution based upon well-documented analysis. 

110. Builds the solutions to possible implementation problems into 
the initial proposal. 

111. Able to recognize the existence of a technical problem before 
all the negative symptoms are apparent. 

112. Tends to look at problems from a common sense, rather than 
scientific point of view. 

113. Expects the implements ticn of every solution to work as smoothly 
as possible. 

114. Attends technical seminars to please the supervisor rather than 
for knowledge that might be gained. 

115. Attempts to quantify all factors of a problem when making a 
technical decision. 

116. Prefers assignments which involve several technical disciplines. 
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117, Implementation of a solution is often stymied by small obstacles • 

118. Prefers to work on rather routine and mundane assignments- 

119, Doesn't monitor a chosen solution until it has been fully 
implemented. 

120. Attempts to quantify all costs and benefits associated with 
the possible consequences of proposed solutions. 
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Second Set of 120 Behavioral Statements 
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Examples Describing the Job Performance of Engineers 

Listed below are some examples which describe how an engineer might 
perform his or her job. We are interested in your judgment about which 
factor related to updating in engineers is most relevant to each example. 
That is, we would like for you to classify or assign each example to the 
updating factor to which that example seems most applicable. 

Read over carefully the ten factors related to updating in engineers 
on the form you have been given. Then, for each example listed below, 
write in the space to the left of the example the letter code of the factor 
which you think the example best represents or describes. 

To illustrate this better, suppose that example 1 was: 

A 1. Writes technical reports which are readily understood by 
organizational management. 

If you wrote an "A" in the space to the left of the example, this would 
mean that you believe that this example best represents o^r describes the 
factor of Technical Communication. 

Do this for all of the examples listed below. Please do not skip any 
examples* 

1. Attends in-house technical seminars. 



2. Frequently offered job opportunities by other units of the 

organization. 

3. Has difficulty applying rigorous mathematical techniques to 

technical problems* 

4. Tends to look for administrative rather than technical assign- 
ments. 

5. Volunteers to give talk on new technical developments to other 

engineers in the organization. 

6. Is able to apply concepts from other engineering and scientific 

disciplines to own work. 

7. Distrusts the use of computer simulations to evaluate engineering 

ideas. 

8. Sometimes displays a negative attitude toward new ideas* 

9. Is always looking for a better way to do a job^ 

10. Has definite career goals and plans for seli-development in 

technical areas. 

11. Has little curiosity about technologies related to own specific 

area. 
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12* Tends to stretch out assignments In which he feels comfortable. 

13. Willing to accept assignments with uncertain chance of success. 

14. Able to admit a lack of knowledge in a technical area. 

15. Often needs help from colleagues in order to complete an assign- 
ment • 

16. Inflexible in approach to engineering design tasks. 

17. Exhibits self-confidence regarding work. 

18. Performs assignments with minimum supervision. 

19. Is rarely consulted by co-workers for technical advice. 

20. Is pessimistic and cynical about new technical developments. 

21. Works extra hours on own initiative. 

22* Has ordered task priorities in accordance with their importance 
to the project. 

23. Uses time deadlines and budget limits as reasons for not trying nev^ 
Ideas. 

24. Usually won*t make technical decisions alone. 

25. Likes to work with recent engineering graduates. 

26. Welcomes the chance to discuss and debate techn1.cal issues with 
other engineers. 

27. Is bored with the job. 

28. Rarely conttibutes to staff discussions Involving technical 
decisions ; 

29. Desires feedback about quality of job performance. 

30. Reluctant to become involved in technical a^ociety affairs. 

31. Teaches an evening course in engineering at a local colleg^i 

32. Dr votes four hours a week reading technical and trade journals. 
33^ Resists assignments in unrajniliar technical areas. 

34. Doesn't adapt well to rapid changes In technology. 

35. Usually presents a paper at a regionH or national technic.*ii 
society meeting each year. 
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36. Initiates the use of new statistical techniques for evaluating 
system performance. 

37. Doesn't consider challenging the "status quo" of a traditional 
approach to an engineering problem. 

38. Adopts an attitude of "if it's Important, someone will tell me 
about it" toward technical developments. 

39. Rarely enrolls in technical courses or seminars held outside the 
company. 

40. Expects the organization and its management to initiate all con- 
tinuing education efforts. 

41. Seeks out for discussion at technical society meetings other 
engineers working in similar areas. 

42. Likes to experiment with new hardware. 

43. Has filed for a patent based upon a solution to a technical 
problem. 

44. Is challenged by technical advances* 

45. Is curious about all technical areas. 

46. Usually asks questions at technical presentations. 

47. Is able to train other engineers in new technology. 

48. Lacks knowledge of technical language and Jargon. 

49. Does not follow up after the major components of a project are com- 
pleted. 

50. Accepts other pr^^ople's opinions about the cause of a problem. 

51. Requires prompting by the supervisor to look for more than one 
possible solution to a problem. 

52. Tells the supervisor of interest in attending technical seminars. 

53. Is not persistent in "de-bugging" a project. 

54. Has become a P.E. 

55. Works on the details of one solution rather than researching 
alternative solutions. 

56. Becomes involved in and "learns" the process or system in which 
a technical problem has occurred. 




57. Is capable of reorganizing a project due to schedule or technical 
specification changes • 

58. Can present information in a logical sequence. 

59. Often misunderstands the basic objective of a technical assign- 
ment* 

60. Cannot defend recommended solution. 

61. Frequently develops a unique solution for an old problem. 

62. Able to distinguish between symptoms and causes of a problem. 

63. Always able to give to the supervisor an Immediate synopis of a 
project ^s status. 

64. Often misses deadlines for completing an assignment. 

65* Will propose and defend the first solution to come to mind. 

66. Is prepared to accept minor changes in solution in order to gain 
its implementation. 

67. Seeks leadership roles in professional societies. 

68. Frequently content to rely upon co-workers for learning about new 
techniques. 

69. Never expresses reluctance to accept an assignment. 

70. Develops a recommended solution based upon well-documented analysis. 

71. Usually offers several solutions to a technical problem for 
management to choose from. 

72. Anticipates implementation problems and builds their solution 
into the proposal. 

73. Willing to spend own time and money to attend outside educational 
functions. 

74. Is never asked to rewrite own technical reports. 

75. Is always able to select the proper engineering technique required 
by the problem. 

76. Often attacks the first symptoms of a problem^ rather than looking 
for its real causes. 

77. Able to establish project priorities without the specific guidance 
of the supervisor. 
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78, Details the possible consequences of each alternative solution 
In all proposals. 

^ 79. Able to recognize the existence of a technical problem before 
negative consequences are apparent. 

^ 80. Is able to instruct others in a phase of technical specialty. 

81. Has no interest in professional registration. 

^ 82. Tends to look at problems from a common sense point of view. 

. 83. Can always describe a technical problem so that non-technical 
people can understand it. 

84. Reads technical literature only when told to by the supervisor. 

85. Goes to the location of a problem to get direct information about 
it. 

86* Expects each solution to work as smoothly as possible. 

87. Believes that all technical societies are a waste of time. 

88. Attends technical seminars for political rather than knowledge 
reasons. 

89. Joins professional societies solely to pad the re3ume. 

90. Attends as many company-sponsored technical seminax's and short 
courses as possible. 

91. Attempts to quantify all factors to a problem. 

92. Prefers to solve a problem from one's desk rather than in the field. 

93. Knows own discipline well but doesn't venture outside it. 

94. Uses inaccurate or misleading, terminology in reports. 

95. Sometimes misses non-critical project deadlines. 

96. Sticks with the original plan for too long when it isn't working 
in a satisfactory fashion. 

97. Is biased against suggestions from other engineers. 

98. Quickly finds the strong and weak points of alternatives. 

99. Is satisfied with own ability to do the job. 

100. Likes assignments involving several technical disciplines. 

101. Can tailor technical presentations to fit the audience. 
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102. Spends too much time on details. 

103. Makes extensive Inquiries regarding problem symptoms. 

104. Projects are sometimes completed late but they are always 
successful. 

105. Is easily stymied by small obstacles to Implementing a solution. 
106* Attends most chapter meetings of the technical society. 

107. Subscribes with own money to several technical publications. 

108. Does best work on mundane assignments. 

109. Is able to coordinate projects with well-defined objectives. 

110. Remains open to new alternatives even after a solution has been 
chosen. 

111. Doesn't re-evaluate a solution until a project Is completed. 

112. Uses excessive manpower and equipment resources due to poor 
project management. 

113. Accepts other's opinions as facts supporting the chosen alternative. 

114. Attempts to quantify all costs and benefits associated with 
proposed solutions. 

115. Does not prejudge any possible solution before the evaluation data 
are complete. 

116. Shows "tunnel vision" regarding approaches to technical problems. 

117. Is hesitant td select an alternative solution for implementation. 

118. Devotes a substantial portion of spare time to reading technical 
publications and taking technical courses. 

119. Procrastinates choosing an alternative to Implement until options 
are lost by the delay. 

120. Reports only the Information pertinent to the problem at hand. 
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APPENDIX D 

Instructions and Behavioral Statements for the 
Eleven Factors for the Statement Scaling Phase and Resulting 
^ Means and Standard Deviations 
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Instructions 

Attached are a rating scale and groups of statements or examples related to 
the technical job performance and technical updating activities of engineers. 
Each group of examples has been placed under the performance or updating factor 
which the examples best describe (as judged by previous groups of engineer^j). 
For each example listed for each of the performance or updating factors, we would 
like for you to judge the effectiveness of the performance, the quality of the 
updating activity, or how much of the factor is shown by the example. 

Use the scale values which are given and defined on the attached rating scale. 
Write the scale value which represents your judgment in the space to the left of 
each example. 

To Illustrate this more specifically, consider the following: 

a. Suppose that the first example listed under Factor A. Technical Com- 
munication was: 

3 1. Reports sometimes have spelling and punctuation errors. 

Writing a 3 in the space to the left of the example would indicate 
that you felt that this represented low effectiveness in the performance 
factor of Technical Communication. 

b. Suppose that the first example listed under Factor I. Continuing 
Education Attempts was: 

7 1. Subscribes to five technical journals related to discipline. 

Writing a 7 in the space to the left of the example would indicate 
that you judged this to be a good way to maintain up-to-date technical 
skills . 

c. Suppose that the first example listed under Factor K. Technical Interest 
and Curiosity was: 

5 1. Likes to tinker with mechanical gadgets. 

Writing a 5 in the space to the left of the example would indicate 
that you felt that this represented an average amount of the factor of 
Technical Interest and Curiosity. 

d. Suppose that the first example listed under Factor C. Organization and 
Planning was: 

6 1. Attends to most of the details of a project. 

Writing a 6 in the space to the left of the example would Indicate 
thsit you judged this to represent performance which was more than 
moderately effective but less than fully effective. 

Thank you for your cooperation. 



73 



Rating Scale - Degree of Technical Performance 
or Updating Activity 



Scale Value Definition of Scale Value 

1 : Completely Ineffective performance and/or very poor 

way no maintain or update technical skills and/or 
very low amount of the factor. 



Low effectiveness In performance and/or marginal way 
"to maintain or update technical skills and/or low 
amount of the factor. 



-Moderately effective performance and/or reasonable 
way to maintain or update technical skills and/or 
average amount of the factor. 



-Effective performance and/or good way to maintain 
or update technical skills and/or high amount of 
the factor. 



8 



-Optimal performance and/or excellent way to main- 
tain or update technical skills and/or very high 
amount of the factor. 
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Factor A. Technical Ccrr.unicat ion - the ability to transmit and receive written 
and oral information related to technical project? and assignments. 

Examples Related to this Factor 



Mean 


S.D. 




7.35 


1.26 


1. 


6.34 


1.87 


2. 


7.24 


1.72 


3. 


4.80 


2.43 


4. 


2.30 


1.70 


5. 


3.33 


1.06 


6. 


7.20 


3.. 13 


7. 


7.91 


. 37 


8. 


7.5C 


_^8. 


9. 


6.71 


1.74 


10. 


2.90 


1.25 


11. 


3.81 


1.73 


12. 




J. . •}/ 


13. 


7.19 


1 .2j 


14. 


"1 Aft 

/.49 


1 . 07 




2.66 


1.33 


16, 


2.65 


1.30 


17. 


7.47 


1.16 


18. 



people can understand it. 



opposed to the change. 

Is able to ask questions of technlca] 
appropriate and needed information. 

Frequently has project proposals aca 
tion with little revision necessary* 

Rarely contributes information to en{ 
of technical problems. 

Communicates well only with engineers 
technical discipline* 

Is frequently asked to make oral pre: 
concerning technical matters* 



1,07 15. Is able to instruct other engineers in new technology. 



a poor presentation. 
1.30 17. Has difficulty documenting technical results. 



1.16 18. Can present information in a logical sequence. 
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Factor B. Scientific and Technical Knowledge - the possession of fundamental 
scientific, mathematical, and engineering knowledge necessary for 
adequate completion of a project or assignment. 

M!^an S.D. Examples Related to this Factor 

3.43 1.46 1. Sometimes makes mathematical errors on an assignment. 



3.68 


1.53 


2. 


Has difficulty applying rigorous mathematical techniques to 








technical problems. 


5.5k 


1.80 


3. 


Has a good working knowledge of calculus and differential equations 


7.49 


1.30 


4. 


Performs assignments with minimum supervision. 


3.44 


1.48 


5. 


Is unfamiliar with the precise technical definitions of many 
scientific terms. 


3.35 


1.42 


6. 


Often needs technical help from colleagues in order to complete 
an assignment. 


7.56 


1.34 


7. 


Is considered the technical expert in the department. 


6.57 


1 V^l 


8. 


Is able to use mathematical techniques of maximizing or mini- 
mizing functions in attacking a problem. 


3.45 


1.50 


9. 


Has difficulty understanding basic electronic designs. 


5.51 


1.65 


10. 


Has fundamental grasp of heat transfer and thermodynamics. 


5.17 


1.92 


11. 


Is aware of recent solid state technology. 


6.17 


1.57 


12. 


Understands statistical inference and sampling techniques. 


6.68 


1.42 


13. 


Can apply basic mechanics to problems. 


4.74 


1.30 


14. 


Often needs help if an assignment requires any knowledge of 



chemistry. 
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Factor C. Organization and Planning - the ability to manage projects, and 

assignments including establishing priorities, meeting deadlines, 
and attending to details. 



Examples Related to this Factor 
!• Sometimes misses non-critical project deadlines. 



Mean 


S.D. 






7.41 


1.12 


7.34 


1.21 


6.44 


1.26 


7.09 


1.26 


5.70 


1.89 


3.14 


1.44 


7.00 


1.36 


7.28 


1.17 


7.61 


.97 


3.48 


1.27 


2.28 


1.23 


7.17 


1.15 


7.92 


1.14 


2.70 


1.39 


7.29 


1.02 


4.01 


1.53 


7.34 


1.12 



2« Has ordered task priorities in accordance with their Importance 
to the project, 

3* Prepares schedules identifying project milestones* 

4. Projects are sometimes completed late but they are always 
successful* 

5* Always able to give to the supervisor an Immediate synopsis of 
a project's status* 

6* Is able to use systematic scheduling procedures such as Gantt 
and PERT methods* 

7* Often misses deadlines for completing an assignment* 

8* Is capable of reorganizing a project due to schedule or technical 
specification changes* 

9* Is able to meet the cost and time schedules of most projects* 

10* Able to establish project priorities without the specific guidance 
of the supervisor* 

11* Often has only a vague idea about how much time each part of a 
project will require* 



project management* 

7*17 1*15 13* Is able to coordinate projects with well-defined objectives* 



within quality control standards. 



possible future projects* 
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(Factor C cont'd) 



3>30 1>18 19, Has difficulty getting new projects started. 

6,63 1.16 20. Has the ability to complete daily project routine despite occasional 
interruptions. 

3.51 1.40 21. Often needs someone else to clean up the details of an assignment. 

3>62 1.48 22. Constantly readjusts the schedule of a project to allow for more 
time for its completion. 

3.06 1.15 23. Does not follow up through implementation after the major 
components of a project are completed. 
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Factor D. Problem Recognition and Definition - the ability to understand the 
cause(s) of the synptoras of a problem. 

Examples Related to this Factor 

Able to recognize the existence of a technical problem before 
all the negative symptoms are apparent. 

2* Accepts other people's opinions about the cause of a problem. 

Often attacks the first symptoms of a problem, rather than 
looking for its real causes. 

4. Often misses one or two important factors in a problem. 



Mean 


S.D. 




7 46 


1 Ofi 


1. 


5.72 


1.97 


2. 


3.29 


1.97 


3. 


3.10 


1.31 


4. 


2.92 


1.46 


5. 


6.77 


1.66 


6. 


6.95 


1.30 


7. 


7.39 


1.19 


8. 


7.25 


.95 


9. 


6.44 


1.36 


10. 


7.23 


1.21 


11. 


3.66 


1.64 


12. 


7.51 


1.41 


13. 



each other and treats each symptom as if it were a separate 
problem. 



before developing a solution. 

7. Makes extensive Inquiries regarding problem symptoms. 

Is able to list all potential causes of the symptoms of a 
problem. 

Is able to identify a specific problem as being an example of a 
general class of problems which has certain possible solutions. 

Usually determines the cause of a problem as the project 
progresses. 

Goes to the location of a problem to get direct information abot 
It. 
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Factor E. Development of Alternative f ^'^ lutions - the ability co create several 
possible solutions to a problem which are technically feasible. 



Mean S.D. Examples Related to this Factor 



7 Qf) 


1 70 

X . 


1 

X • 




5.90 


1.11 


2. 


Usually thinks of alternative solutions, but needs some direction 








to fully develop them. 


3.61 • 


1.43 


3. 


Rarely can develop more than one possible solution to a technical 








problem. 


A. 15 


1.59 


4. 


Develops a second approach to a problem only when the first 








approach fails. 


2.84 


1.48 


So 


Will propose and defend the first solution to come to mind. 


7.01 


1 . 71 


6. 


Frequently develops a unique solution for an old problem. 


A. 30 


1.31 


7. 


Works on the details of one solution rather than researching 
alternative solutions. 


6. CC 


1.58 


8. 


Usually offers several solutions to a technical problem for 








management to choose from. 


3.70 


1.22 


9. 


Requires prompting by the supervisor to look for more than one 
possible solution to a problem. 


3.2; 


1.41 


10. 


Doesn't consider challenging the "status quo" of a traditional 








approach to an engineering problem. 


7„44 


1.36 


11. 


Creates Imaginative solutions to long-term problems. 



88 



80 

Factor F* Evaluation of A l ternnt::ve Sol utions - the use of theoretical, analytical, 
and empirical methods to determine the likely consequences of alterna- 
tive solutions. 



Mean 


S.D. 




Examples Relatec* to this Factor 


7.39 


1.20 


1. 


Selects a solution tiised upon well"*documented analysis. 


7,18 


1.13 


2. 


Attempts to quantify all factors of a problem when making a 


3.35 


1.44 


3. 


Sometimes cannot point out the comparative advantages and 








disadvantaged of two al ternat ives • 


6.31 


1.81 


4. 


Does not prejudga any possible solution before the evaluation 










7.10 


1.41 


5. 


Attempts to quantify all costs and benefits associated with the 
possible consequences of proposed solutions. 


^ 95 


1.44 




n^^'a-l^c n/^cc'lKlo nn conii onr* oQ oAoVi a1 ^P1*nA^ *{ VP ^oltltllon 

in all proposals. 


6.76 


1.38 


7. 


Develops g'raphs, diagrams, and calculations for the evaluation 








of alternatives. 


7.45 


1.03 


S. 


Quickly finds the strong and weak points of alternatives. 


6.52 


1.69 


9. 


Applies statistical models to develop simulation studies of 








sltf^rria elves. 


6.35 


1.79 


10. 


Uses statistical inference as basis for choosing alternative. 
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Factor G. IrTiplcmentation of Chosen Alternative - the ability to make an alterna- 
tive operational by fitting the solution to the particular situation. 

Examples Related to this Factor 

Forces the chosen alternative solution into operation, compro- 
mising some of the desired goals of the project. 

Is prepared to accept minor changes in solution in order to ge 
Its Implementation. 





S.D. 




4.15 






6.70 


1.19 


2. 


5.72 


1.46 


3. 


7.56 


1.12 


4. 




1 01 


C 

3* 




1 43 




3.20 


1.41 


7. 


2.62 


1.34 


8. 


6.75 


1.24 


9. 



at rated capacity, 

4, Anticipates ijnplementat.ion problems and plans for their solution. 

Expects every solution to work as smoothly as possible upon 
Implement at ion . 

Sticks with the original solution for too long, until it is not 
working in a satisfactory manner. 

Tries to implement a new production line layout before being 
sure that production management fully understands it. 

Rigidly adheres to textbook solutions without considering 
the specific situation. 

Can usually overcome small obstacles to the implementation of 
a solution. 
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Factor H. Professional Activities - the extent to which the engineer participates 
in professional registration and society activities. 

Mean S.D. Examples Related to this Factor 

3.53 1.45 1. Reluctant to become involved in technical society affairs. 

5.71 2.22 2. Is registered as a P.E. 

2.79 1.54 3. Joins professional societies solely to pad the resume. 

3>47 1.62 4. Has no interest in professional registration. 

6.28 2.19 5. Usually presents a paper at a regional or national technical 
society meeting each year. 

5.71 6. Usually attends the meetings of the local technical society. 

3>77 1.49 7. Has never submitted a paper for presentation at a technical 
society meeting. 

5.49 1.81 8. Attends most chapter meetings of the technical society. 

6.40 2>13 9. Teaches a P.E. refresher course for the local professional society 
chapter, 

3>73 1.74 10. Has never become an E.I.T. 

2.64 1.47 11. Believes that all technical societies are a waste of time. 
6.79 1.80 12. Seeks leadership roles in professional societies. 



f 
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Factor I. Continuing Education Attempts - the type of procedure used by the 
engineer to maintain or obtain up-to-date technical skills. 





S.D. 




Examples Related to this Factor 


6.79 


1.52 




Devotes a substantial portion of spare time to reading technical 








publications and taking technical courses. 


6.71 


1.36 


^ • 


Awuciius uccnnxCcix pc^csdiuciuxuns suggcsuca uy tnc supcxvxsoc^. 


6.58 


1.39 


3. 


Follows a program of professional development which his or her 








supervisor suggested. 


7.27 


1.32 


4. 


Has made definite plans for self*-development in technical areas. 




1 70 
1 • / Z 


J m 


c»nc^uxx5> m unxvcxoxuy cuuxscs on ciuvckiccu uccnnxccix uwpxcs. 








oUDScrxDes wxun own mone^ to severax uecnnxcax puDxxcauxons. 


6.33 


1.94 


7. 


Periodically attends technical seminars at own expense. 


2.53 


1.42 


8. 


Never attends an in-house technical seminar. 


Om / D 




Q 


A^^An«4e tnonv /^/^Tnnisn VMcnrtncrti* A/i ^ A/*f^n ^ 1 OAfn^i^^T*o Qnm*^ 
AUucnOS ci&> UMllljr CUlupany bpunsiUXcVl UcCiitlxCaX Scul XtlciC^ o cillQ oilUL. C 

courses as possible. 


2.65 


1.30 


10 


QtsafiQ technical literature onlv when told to bv the SUoervisor. 


6.40 


1.94 


11. 


Willing to spend own time and money to attend outside educational 








functions. 


3.68 


1.60 




Exnerts the organization and its management to initiate all con— 








tinuing education efforts. 


3.80 


1.14 


13. 


Rarely enrolls in technical courses or seminars held outside the 








company. 


6.54 


1.26 


14. 


Attends in-house technical seminars. 


3.14 


1.37 


15. 


Frequently content to rely. upon co-workers for learning about new 








techniques^ 


5.86 


2.09 


16. 


Attends seminar series on microprocessors on own time. 
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Factor J, Work Assignments Soueht - the type of job activities desired and 
pursued by the engineer. 

Examples Related to this Factor 

1. Prefers assignments which involve several technical disciplines, 

2. Prefers to work on rather routine and mundane assignments, 

3. Is willing to accept an assignment which has an uncertain chance 
of success, 

4. Tends to remain with assignments in which he feels comfortable, 

5. Discusses with the supervisor his or her interest in assignments 
involving computer-based analytical methods. 

6. Tries to get assignments which focus on different applications of 
a specific technical interest. 

7. Is content to remain in current job for an indefinite amount of 
time, 

8. Desires assignments which are more administrative than technical. 

9. Never expresses reluctance to accept an assignment. 

10, Tells the supervisor of interest in attending technical seminars. 

11, Accepts work assignments as given, 

12, Tries to avoid assignments in unfamiliar technical areas. 



Mean 


S.D. 


7.15 


1 22 


3.13 


1.42 


6.66 


1.43 


4.56 


1.60 


O • Uv 




6,54 


1,28 


^ AS 




A.63 


1.64 


5.68 


1.90 


6.92 


1.16 


5.90 


1.40 


3.40 


1.48 
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Factor K. Technical Interest and Curiosity - The interest and curiosity shown 

by the engineer regarding technology, science, and recent developments 
In both. 

Examples Related to this Factor 

1. Is curious about all technical areas. 

2. Is pessimistic and cynical about new technical developments. 

3. Doesn't adapt well to rapid change in technology. 

4. Is excited about technical developments. 

5. Sometimes displays a negative attitude toward new ideas. 



Mean 


S.D. 


7 19 


1.32 


2.73 


1.33 


2.98 


1.20 


7.18 


1.28 


3.56 


1.40 


2.80 


1.58 


6.72 


1.54 


2.47 


1.45 


2.62 


1.44 


5.25 


1.71 



6. Has little curiosity about technologies related to own 
specific area. 

7. Works extra hours on own initiative. 

8. Is bored with the job. 

9. Adopts an attitude of "if it's important, someone will tell 
me about it" toward technical developments. 

10. Occasionally reads journals in related technical areas. 
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APPENDIX E 

Cover Letter, Instr,<;tions, Demographic Information Sheet 
for the Final Rating Scales 
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The Pennsylvania State University 

615 BRUCE V. MOORE BUILDING 
UNIVERSITY PARK, PENNSYLVANIA 16802 

December 7, 1979 

Project for Area Code 8 14 

Technical Updating of Engineers 863-1734 



As you know, we are involved in an N.S.F. sponsored project concerning technical 
updating of engineers. As part of this project, we are developing rating scales 
which can be used by a supervisor to describe the technical job performance and techni- 
cal updating activities of subordinate engineers. We are asking you, as someone who 
has helped us in earlier phases of this project, to participate in the final step in 
the development of these scales. 

We have assembled a set of eleven rating scales, one for each factor which was 
identified in earlier phases of the project as important to the technical performance 
and updating of engineers. In addition to the numerical scale values usually found 
on rating scales, examples of the particular performance or activity are given to help 
define the various levels of each scale. These examples were suggested by groups of 
engineers in earlier phases of the project and were judged by other groups in terms of 
the appropriate level of performance which they exemplified. 

We would like you to describe two engineers whom you supervise, in terms of the 
eleven factors. Two sets of scales are provided for this purpose with some additional 
instructions. Please do not identify by name the engineers whom you are describing. 
We do ask for some information on them on the first page of each set of scales. All 
information and ratings will be kept confidential, and no data on any individual will 
be released. 

We would appreciate any comments you might have concerning the scales and their 
potential usefulness for a supervisor, particularly in the area of counseling or 
developing subordinate engineers in terms of their technical performance. 

Please return the two sets of rating scales and any comments which you have in 
the envelope which is enclosed. Thank you in advance for your cooperation. Call one 
of us (Enscore - 814-863-2353; Farr - 814-863-1734) if we can answer any questions. 
We would appreciate your returning the ratings within the next two weeks. 

Sincerely, 



E. Emory Enscore, Jr., Ph.D. James L. Farr, Ph.D. 

Assoc. Prof, of Industrial Engineering Assoc. Prof, of Industrial Psychology 
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Instructions 



Each of the following pages represents a factor which has been previously 
identified by groups of engineers as being an important component of the 
technical performance or the technical updating process of engineers. For each 
factor, a vertical scale is presented with numerical values ranging from 1-9. 
We would like you to describe the typical work activity of the engineer whom 
you have selected to evaluate on each of the eleven factors. Place the number 
indicating your judgment in the space provided below the vertical scale. Limit 
your judgment to one decimal place (for example, 6.2 or 5.0 or 3.5) . To the 
right of the vertical scale are various examples which have been suggested by 
previous groups of engineers as relating to this factor. Use these examples as 
a guide for the numerical ratings which you give. These examples are grouped 
into three general performance categories: more than adequate, adequate, and 
less than adequate. These examples should help you xinder stand what kinds of 
performance or activity correspond to the various numerical values on the scale. 

At the bottom of each page is a space for you to give an example or 
examples of the typical work activity of the engineer relevant to the particular 
factor. Indicate ii. this space an example or examples of the work activity of 
the engineer which le\ you to give the engineer the particular numerical rating 
which you placed in the space above. The example or examples stated here might 
be thought of as indicating the work activities which would justify the numeri- 
cal value. 

Remember to describe the typical work activities of the individual, not 
the unusually good or bad. Please be sure that you have not skipped or omitted 
any of the eleven factors. (Note that the scales are printed on both sides) 
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Describe the engineer whom you are evaluating by checking the appropriate 
categories below: 



Ed ucatlonal levels Age: 

Bachelor's degree ^ 30 

Master's degree In technical area 30 ~ 39 

M.B.A. 40 - 49 

Doctorate 50 _ 59 

Other (specify ) ^ 60 



Engineering Discipline: 

A.E. 

Ch.E. 

C.E. 

E.E. 

I.E. 

• M.E. 

Systems E. 

Other (speclfy_ 



Years with Organization: 

< 1 

1-3 

3-5 

5-7 

> 7 



Years under your supervision: 

< 1 

1-3 

3-5 

5-7 
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APPENDIX F 
Alphabetical List of Participating 
Industrial Organizations and Government Agencies 
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Industrial Organizations 

Air Products & Chemicals, Inc., Allentown, FA 

American Sterilizer Co., Erie, PA 

Applied Research Laboratory, University Park, PA 

Armstrong Cork Corporation, Lancaster, PA 

Babcock & Wilcox Research Center, Alliance, OH 

Bethlehem Steel Corporation, Bethlehem, PA 

Eloom Engineering Co., Inc., Pittsburgh, PA 

Bucyrus Erie Co., Erie, PA 

Canrad-Hanovla, Inc., Newark, NJ 

Centre Engineering, Inc., State College, PA 

Cerro Metal Products, Belief on te, PA 

Cleveland Twist Drill Company, Cleveland, OH 

Consolidated Rail Corporation, Altoona, PA 

Copes-Vulcan, Inc., Lake City, PA 

Corning Glass Works, State College, PA 

Corry Jamestown Corporation, Corry, PA 

Eastman Kodak Co., Rochester, NY 

Fuller Co., Bethlehem, PA 

General Electric Co., Allentown, PA 

Geosource, Inc., Erie, PA 

General Electric Co., Erie, PA 

Grumman Aerospace Corporation, Bethpage, NT 

H R B-Singer, Inc*, State College, PA 

Hamilton Technology, Lancaster, PA 

Hershey Chocolate Company, Harshey, PA 

Hoke, Inc., Cresskill, NJ 

Ingersoll-Rand Co., Allentown, PA 
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International Signal & Control, Lancaster, PA 
J & L Steel, Aliquippa, PA 

Joy Manufacturing Company, Bedford Gear Division, Solon, OH 
Kavmeer Company, Bloomsburg, PA 
Koppers Co., Inc., Pittsburgh, PA 
Leviton Mfg. Co., Inc., Little Neck, NY 
Mack Trucks, Inc., Allentown, PA 

Management Engineering, The Pennsylvania State University, University 
Park, PA 

Marathon Carey McFall Co., Montoursville, PA 

Masland, C. H. and Son, Lewistown, PA 

Matthews International Corporation, Pittsburgh, PA 

Merck, Sharp & Dohme, West Point, PA 

Neville Chemical Co., Pittsburgh, PA 

New Cumberland Army Depot, New Cumberland, PA 

New Jersey Zinc, Palmer ton, PA 

Packard Electric, Warren, OH 

Parker Hannifin Corporation, Cleveland, OH 

Pennsylvania House Furniture Co., Lewisburg, PA 

Pennsylvania Power & Light Co., Allentown, PA 

Piper Aircraft, Inc., Lock Haven, PA 

RCA, Moor est own, NJ 

Republic Steel Corporation, Cleveland, OH 

Rockwell International, Newark, OH 

Scott & Fetzer Co., Stahl Division, Cleveland, OH 

Shop-Vac Corp., Williamsport, PA 

Sperry Division Headquarters, Great Neck, NY 

Sperry New Holland, Belleville, PA 

Sperry New Holland, New Holland, PA 
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Sprout Waldron Koppers, Muncy, PA 

Standard Steel Division, TMCA, Burnham, PA 

Sutton Engineering Company, Bellefonte, PA 

TRW, Inc., Danville, PA 

Teledyne Penn Union, Edinboro, PA 

Thomas J. Lipton, Inc., Englewood Cliffs, NJ 

Universal-Cyclops Specialty Steel Division, Bridgeville, PA 

Weis Markets, Inc., Sunbury, PA 

Weston Instruments, Division of Scngamo Weston, Inc., Newark, 
Wilbur B. Driver Co., Newark, NJ 
Xerox Corporation, Rochester, NY 
Zenith Audio Division, Watsontown, PA 
Zurn Industries, Erie, PA 

Government Agencies 

Federal Aviation Administration, Washington, DC 

Massachusetts Bureau of Building Construction, Boston, MA 

Massachusetts Dept. of Labor & Industries, Division of 
Occupational Hygiene, Boston, MA 

Massachusetts Dept. of Public Works, Boston, MA 

Massachusetts Division of Air & Hazardous Materials, 
Boston, MA 

Massachusetts Division of Water Pollution Control, 
Boston, MA 

Pennsylvania Dept. of Environmental Resources, Pittsburgh, PA 

Pennsylvania Dept. of Environmental Resources, Bureau of 
Water Quality Management, Harrisburg, PA 

Pennsylvania Dept. of General Services, Harrisburg, PA 

Pennsylvania Dept. of Transportation, Harrisburg, PA 



Pennsylvania Dept. of Transportation, Pittsburgh, PA 

Pennsylvania Turnpike Commission, Harrisburg, PA 

Pennsylvania Public Utility Commission, Bureau of Rates, 
Harrisburg, PA 

U.S. Army Corps of Engineers, Pittsburgh, PA 

U.S* Defense Nuclear Agency, Washington, DC 

U.S» Department of Energy, Germantown, MD 

U.S. Department of Housing & Urban Development, Pittsburgh, PA 

U.S. Department of Transportation, Research & Special Programs 
Administration^ Washington, DC 

U.S. Department of Transportation, Transportation Systems Center, 
Cambridge, MA 

U.S. Department of Transportation, Urban Mass Transportation 
Administration, Washington, DC 
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